Hi, my name is
Lead Software Engineer with over a decade of expertise specializing in ETL processing.
As a Python developer, I take pleasure in crafting clean, maintainable code that adheres to industry standards. My capability to confront complex challenges directly, combined with my analytical approach, renders me a significant asset to any team dedicated to data-driven decision-making. My commitment to excellence, along with my technical skills, positions me as an ideal candidate for leading success in data-focused projects. I bring a significant amount of experience as a Python software developer, specializing in AWS Glue, PySpark, and ETL processing. My passion for data engineering has enabled me to design and implement effective solutions that enhance data workflows and improve overall efficiency. My proficiency in AWS Glue is defined by a thorough understanding of its features, which allows me to create scalable and maintainable ETL pipelines. I have effectively utilized PySpark to manipulate and process large datasets, ensuring optimal performance and providing valuable insights to stakeholders. In addition to my knowledge of AWS Glue and PySpark, I have a strong foundation in Hadoop administration. This skill set empowers me to manage distributed storage and processing frameworks efficiently, ensuring the seamless operation of big data environments. My commitment to remaining informed about industry trends and adopting best practices positions me as a reliable and innovative professional. Whether it involves optimizing data pipelines, troubleshooting issues, or collaborating with cross-functional teams, I excel in delivering solutions that meet and exceed expectations.
December 2023 - Present
Offer technical leadership, in supporting the complex design and seamless implementation of ETL (Extract, Transform, Load) processes. In close collaboration with experienced architects, my focus extends to the development of highly scalable systems, ensuring a robust foundation for efficient data handling and transformation. By leveraging my expertise, I contribute to the creation of streamlined ETL solutions that not only meet the current business needs but also align with long-term scalability and adaptability goals.
June 2022 - December 2023
Create and deploy Extract, Transform, Load (ETL) solutions tailored to align with business requirements. Collaborate seamlessly with cross-functional teams, offering technical expertise and troubleshooting support for issues related to data extraction and transformation processes.
May 2020 - June 2022
Create, construct, and validate Big Data Infrastructure solutions both on-site and in public clouds, employing Infrastructure as Code (IaC) technologies for automated processes. Innovate and implement new solutions to enhance the Big Data ecosystem, ensuring the overall security of the platform is maintained.
September 2013 - May 2020
Developed, programmed, and maintained PHP and Python command-line interfaces to facilitate transactional record retrieval from Apache Hadoop. Crafted queries using HiveQL and/or MySQL to extract relevant records and generate comprehensive reports.
February 2011 - September 2013
Performed in-depth analysis of infrastructure data to generate tailored reports. Assisted Law Enforcement Agencies by addressing inquiries, handling legal requests, and preparing comprehensive reports.
Connect with me.
Come see what I'm working on.
Send me a message.