Blog

Position Details

Requirement

CREQ

CREQ195612

No of Positions

1

Role

Senior Data Engineer

Location

Remote – customer based in Chicago IL (East Coast Based resources only considered)  

Type of Hire – Contract/ C2H

Contract 

Pay Rate

$55/hr *firm

Duration

1 + year

Number of Interviews

2

In person interviews Yes/No

No

Client Interview Yes/No

Yes

Position requirements

1. Data Engineer
2. Databricks
3. SQL
4. Programming language
5. Cloud Platforms
6. Stream Processing
7. Certifications

Customer: Virtusa/ Sheetz – Retail company

Requirements:

• Bachelor's degree or experience in Data Science and Management field.
• At least 8 years’ experience as a Data Engineer or similar role.
• At least 3 years’ experience with Databricks on any cloud platform 
• Strong proficiency in SQL and experience with relational databases.
• Proficiency in at least one programming language (e.g., Python, Java, Scala) for data processing and scripting.
• Knowledge of data modeling and database design principles.
• Good experience with cloud platforms, such as AWS, Azure, or Google Cloud.

Preferred Qualifications:

• Bachelor’s degree in Computer Science, Engineering, Mathematics or a related field.
• Experience with stream processing technologies. i.e., Kafka
• Knowledge of data governance and security best practices.
• Experience and Certifications in AWS and Databricks technologies.

Responsibilities:

• Design, develop, and maintain scalable and efficient data pipelines for extracting, transforming, and loading (ETL) data from various sources into our data warehouse leveraging AWS, Databricks, Python and SQL technologies.
• Optimize and troubleshoot existing data pipelines for performance and reliability.
• Implement data quality and validation processes to ensure accuracy and consistency of data.
• Assemble large, complex sets of data that meet non-functional and functional business requirements.
• Identify, design and implement internal process improvements including re-design infrastructure for greater scalability, optimize data delivery, and automating manual processes.