Hello,
Hope you are doing Good !!
Please find the below requirement for Data Engineer. Would you be interested please share me updated resume to proceed further.
Position: Data Engineer
Location: New York, NY (Onsite)
Duration: 9+ months Contract
Client: TCS
Job Summary:
The Cognito Data Fusion Engineer is responsible for designing, developing, and maintaining data integration solutions using cloud-native platforms like Google Cloud's Data Fusion. The role involves working closely with data architects, data scientists, and business stakeholders to manage data pipelines, integrate diverse data sources, and ensure seamless data flow across systems while ensuring data governance, security, and scalability.
Key Responsibilities:
- Data Integration & Orchestration:
- Design, develop, and deploy data pipelines using Google Cloud’s Data Fusion.
- Integrate diverse data sources, including on-premise, cloud-based, and third-party systems.
- Implement ETL (Extract, Transform, Load) processes to ensure efficient data flows.
- Ensure data transformation and aggregation to meet business requirements.
- Data Management:
- Maintain and optimize data pipelines for performance and scalability.
- Monitor data quality and ensure integrity across all data processes.
- Collaborate with data engineering teams to ensure secure and compliant data handling.
- Solution Design & Collaboration:
- Work with cross-functional teams to gather requirements and design appropriate data architectures.
- Collaborate with data scientists, analysts, and product managers to deliver insights.
- Participate in code reviews, and contribute to the design and implementation of new data features.
- Cloud Infrastructure:
- Manage and configure Google Cloud services related to data storage, security, and processing.
- Ensure the security and governance of data in compliance with organizational and regulatory standards.
- Implement automation and monitoring tools to track pipeline performance and resolve issues proactively.
- Optimization & Troubleshooting:
- Identify bottlenecks in data pipelines and propose optimizations.
- Provide ongoing maintenance and support for existing data integration solutions.
- Troubleshoot issues with data ingestion, transformation, and storage.
Required Qualifications:
- Bachelor’s degree in computer science, Data Engineering, or related field.
- Experience with Google Cloud Data Fusion, Google Cloud Platform (GCP) services like BigQuery, Cloud Storage, Cloud Composer, etc.
- Proficiency in ETL tools, data orchestration, and integration patterns.
- Strong programming skills in Python, Java, or SQL.
- Knowledge of cloud infrastructure, containerization (Docker, Kubernetes), and CI/CD pipelines.
- Understanding of data governance, data security, and privacy practices.
Preferred Qualifications:
- Certification in Google Cloud or relevant cloud technologies.
- Experience in Cognito Identity Services for managing user data, authentication, and authorization.
- Familiarity with AI/ML models and data lakes.
Required Education: At least a bachelor’s degree( or equivalent experience) in Computer Science, Software/Electronics engineering, Information Systems, or closely related field is required.
Thanks & Regards,
Pavan Yantrapati,
Email: [email protected]
|
| |
|