Hey,
I hope you are doing well.
My Name is Purushottam Pandey and I am a Staffing Specialist. I am contacting you about an exciting job opportunity with one of our Clients. Please have a look and if you are comfortable please revert me with your Updated resume.
Databricks Certified Data Engineer Associate
New York City, NY – Onsite
Contract – Long term
Job Description :
Position Overview: We are looking for a skilled Databricks Engineer to design, develop, and maintain our data engineering infrastructure using Databricks. The ideal candidate will have a strong background in data engineering, experience with cloud platforms (such as AWS, Azure, or Google Cloud), and expertise in implementing and optimizing data pipelines using Databricks.
Responsibilities:
· Design, build, and maintain scalable and reliable data pipelines using Databricks.
· Collaborate with cross-functional teams to understand data requirements and develop solutions to meet business needs.
· Optimize and tune Databricks clusters for performance and cost-efficiency.
· Implement data security and governance best practices within Databricks environment.
· Troubleshoot and resolve issues related to data pipelines, Databricks clusters, and integrations with other systems.
· Stay updated on the latest Databricks features and best practices and recommend improvements to existing infrastructure.
Requirements:
· Bachelor’s degree in Computer Science, Engineering, or a related field.
· Proven experience as a Data Engineer or similar role, with a focus on building and optimizing data pipelines.
· Hands-on experience with Databricks, including Spark programming (Scala/PySpark), Databricks Delta, and Databricks Runtime.
· Strong SQL skills and experience working with large-scale datasets.
· Experience with cloud platforms such as AWS, Azure, or Google Cloud.
· Familiarity with data modeling, ETL processes, and data warehousing concepts.
· Excellent problem-solving skills and attention to detail.
· Strong communication and collaboration skills, with the ability to work effectively in a team environment.
Thanks and Regards,
Purushottam Pandey | Technical Recruiter
| SYSMIND, LLC
| Phone: 609-897-9670 x 5102
| E-mail: [email protected]