Data Engineer : with Python/Scala/AWS : Need X capital one :: w2/c2c need both profiles
• Design, develop, and maintain scalable data pipelines using Python and Scala. • Implement data integration and ETL processes to ingest data from various sources into the data lake and data warehouse. • Optimize and manage large datasets in both relational and non-relational databases. • Ensure data quality and consistency through rigorous testing and validation procedures. • Collaborate with data scientists and analysts to provide data solutions for their analytical and machine learning needs. • Implement and manage AWS infrastructure components such as EC2, S3, Lambda, RDS, Redshift, Glue, EMR, and others. • Monitor and troubleshoot data pipelines and workflows to ensure reliable and timely data availability. • Participate in the design and architecture of data solutions to meet business requirements. • Stay updated with the latest industry trends and technologies to drive continuous improvement and innovation.
Kind Regards, Shubham Sharma Talent Acquisition Hiring Manager| MAASco Tech LLC| www.maascotech.com [email protected] 2525 Xylon Ave S Minneapolis Minnesota, 55426(USA)
• Design, develop, and maintain scalable data pipelines using Python and Scala. • Implement data integration and ETL processes to ingest data from various sources into the data lake and data warehouse. • Optimize and manage large datasets in both relational and non-relational databases. • Ensure data quality and consistency through rigorous testing and validation procedures. • Collaborate with data scientists and analysts to provide data solutions for their analytical and machine learning needs. • Implement and manage AWS infrastructure components such as EC2, S3, Lambda, RDS, Redshift, Glue, EMR, and others. • Monitor and troubleshoot data pipelines and workflows to ensure reliable and timely data availability. • Participate in the design and architecture of data solutions to meet business requirements. • Stay updated with the latest industry trends and technologies to drive continuous improvement and innovation.
Kind Regards, Shubham Sharma Talent Acquisition Hiring Manager| MAASco Tech LLC| www.maascotech.com [email protected] 2525 Xylon Ave S Minneapolis Minnesota, 55426(USA)
To unsubscribe go here: https://go.madmimi.com/opt_out?pact=3562680-182476971-14871523658-0e4f7eb5d32aff4b57ef432ab93b59465205f185