Blog

Note : If you have received this mail in error or prefer not to receive such emails in the future, please reply with “REMOVE” in the subject line and the email id(s) to be removed. All removal requests will be honored ASAP. We sincerely apologize for any inconvenience caused

Hi:

I have an urgent opening on Sr. Lead Data Engineer with my client. Kindly let me know if you are available and interested for the below position, If interested, Kindly revert back with your updated resume to discuss more about this position.

Need Locals to Scottsdale AZ and Visas: USC, GC, GC EAD

Requirement Details:

Role:- Sr. Lead Data Engineer

Location : Scottsdale AZ(3Days a week)

Duration: 12+ Months

HAS TO SIT ONSITE 3 times a week in Scottsdale AZ

Job Description:

Looking for a Lead Data Engineer to assist us in solutioning architecture as we transform the Rebate Processing System from its legacy platform. This person will assist our software engineers in rearchitecting, transforming, and designing data pipelines.

Desired skills: Map Reduce, Spark Streaming, PySpark, Hive, HDFS, Kafka, Redis, Sqoop, Oozie, IBM Data Sage, Spring Batch

Required skills:

10+ Years of IT Experience

5-7 years of data engineering experience

Healthcare experience is required

Capable of leading other data engineers

3+ years of experience with Apache Airflow and/or Composer

3+ years of experience with DataProc and/or Spark

5+ years of experience with CI/CD

Experience producing architecture solutions using Composer and Spark

Experience in large-scale batch processing with cloud services

Ability to collaborate with architects to solve problems and provide data engineering solutions

Familiarity with databases and SQL

Familiarity with at least one OOP language, Java preferred

Familiarity with GCP, GKE, and Cloud IAM