Job Title: AWS – Databricks Architect (12 +Yrs of Experience)
Location: San Diego, CA (Onsite – 3 days)
Duration: Long Term
Job Description :
Lead and manage a team of engineers and Sr engineers by providing guidance, mentorship, and fostering a collaborative work environment.
Establish and maintain positive relationships with client stack holders
Consult with client on project status, proposals, and technical issues and provide post-implementation support to them
Facilitates communication and collaboration between onshore and offshore teams, and ensure the successful design, development and execution of the product\project\deliverables on time
Experience in POC development, Capacity sizing, Tool Evaluation
MUST Have
- Possess excellent written and verbal communication skills.
- Ability to run ETL jobs in Databricks
- Unity catalog with delta, MongoDB, regular s3 based parquet files
- Delta format based S3
- Ability to articulate pros and cons of delta format
- Ability to run Databricks with AWS glue catalog
- Monitoring of Databricks jobs
- Operations related experience of Databricks jobs
- Best practices of setting up nested ETL jobs
- Scheduling of jobs in Databricks
- Passing runtime parameters to ETL jobs
- Handling experience in AWS in data engineering project
- Ability to coordinate/work with team in India
- Good to Have
- Experience in client facing role
Regards
Sagar Bhardwaj
Sr. Technical Recruiter
300 Alexander Park |Suite #200|Princeton , NJ 08540
Office: +1 7324521006 Ext238
Email: [email protected]| URL: http://www.diverselynx.com