Role: Data Engineer
Location:Virginia (Onsite)
Duration: long term contract
Passport number is mandatory
Required Skills : Python ,PySpark ,AWS ,SQL ,Unix
Job Summary
As a Data Engineer with 5 to 7 years of experience, you will play a pivotal role in analyzing business processes and leveraging data to drive strategic decisions.
Your expertise in Python, PySpark, AWS, SQL, and Unix will be crucial in optimizing our data infrastructure and ensuring seamless business operations.
You will collaborate with cross-functional teams to deliver impactful insights and solutions.
Roles & Responsibilities :
Data Engineer processes to identify areas for improvement and optimization.
Develop and maintain data pipelines using Python and PySpark to ensure efficient data processing.
Utilize AWS services to manage and deploy scalable data solutions.
Write and optimize SQL queries to extract and manipulate data for analysis.
Implement Unix scripts to automate routine tasks and enhance system performance.
Collaborate with stakeholders to gather requirements and translate them into technical specifications.
Provide actionable insights through data analysis to support strategic decision-making.
Create and maintain comprehensive documentation for data processes and business workflows.
Conduct data validation and quality checks to ensure accuracy and reliability of data.
Lead data-driven projects from inception to completion, ensuring timely delivery and alignment with business goals.
Communicate findings and recommendations to both technical and non-technical audiences.
Stay updated with industry trends and best practices to continuously improve data solutions.
Work closely with IT and development teams to integrate data solutions into existing systems.
Qualifications
Possess strong analytical skills with the ability to interpret complex data sets.
Demonstrate proficiency in Python and PySpark for data processing and analysis.
Have hands-on experience with AWS services for data management and deployment.
Show expertise in writing and optimizing SQL queries for data extraction and manipulation.
Be skilled in Unix scripting for automation and system performance enhancement.
Exhibit excellent communication skills to effectively collaborate with cross-functional teams.
Display a proactive approach to problem-solving and continuous improvement.
Hold a Bachelor’s degree in Computer Science, Information Technology, or a related field.
Have a proven track record of delivering data-driven projects on time