Blog

ETL Developer with AWS & Python Experience

Job Location:  Available to work Hybrid, NYC/NY. ( Local only)

Job Description:

ETL Developer with AWS & Python Experience

Position Overview

We are seeking a skilled and motivated ETL (Extract, Transform, Load) Developer with strong expertise in AWS (Amazon Web Services) and Python to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining robust ETL processes to support our data integration and analysis needs. This role requires a deep understanding of data warehousing, data modeling, and a keen ability to translate business requirements into effective ETL solutions.

Key Responsibilities

• Design and Develop ETL Processes: Create and maintain efficient ETL pipelines to extract data from various sources, transform it to meet business requirements, and load it into data warehouses and other storage solutions.
• AWS Integration: Leverage AWS services such as S3, Redshift, Glue, Lambda, and RDS to design and implement scalable and secure data integration solutions.
• Data Modeling: Develop and maintain data models to support analytical reporting and data visualization needs.
• Python Scripting: Utilize Python for scripting and automation tasks within the ETL processes, ensuring data accuracy and reliability.
• Performance Optimization: Monitor and optimize ETL processes for performance and efficiency, identifying and resolving bottlenecks and issues.
• Data Quality and Governance: Implement data quality checks, validation rules, and ensure compliance with data governance policies.
• Collaboration: Work closely with data analysts, data scientists, and business stakeholders to understand requirements and deliver data solutions that meet their needs.
• Documentation: Maintain comprehensive documentation of ETL processes, data flow diagrams, and data mappings.
• Troubleshooting: Provide support and troubleshooting for ETL issues, ensuring timely resolution of problems.

Qualifications

• Education: Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Experience:
• Minimum of 8+ years of experience in ETL development.
• Proven experience with AWS services related to data integration and storage.
• Strong proficiency in Python for ETL scripting and automation.
• Technical Skills:
• Expertise in data warehousing concepts and best practices.
• Experience with SQL and relational databases (e.g., PostgreSQL, MySQL).
• Familiarity with data modeling tools and techniques.
• Knowledge of big data technologies (e.g., Hadoop, Spark) is a plus.
• Soft Skills:
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.
• Ability to work in a fast-paced, agile environment.

Preferred Qualifications

• AWS certification (e.g., AWS Certified Solutions Architect, AWS Certified Big Data – Specialty).
• Experience with other programming languages (e.g., Java, Scala).
• Familiarity with data visualization tools (e.g., Tableau, Power BI).
• Knowledge of machine learning and data science concepts.