Blog

Hi,

I do have requirement for the below position.

Job Title: DATABRICKS ML ENGINEER

Location: [NYC, NY, 10003] (Hybrid,)

Work Authorization: USC, GC, GC-EAD, H4

Duration: 12 Months

End-Client: Con-Edison (Working with Prime Vendor)

Experience: 10+ Years

Energy domain experience required

Job Description:   

Our client operates one of the world's largest energy delivery systems, constantly at the forefront of innovations in developing technology. If you’re up to the challenge, then take a chance at this rewarding opportunity!

Position Overview:

•          Applies engineering disciplines to cloud computing and brings a systematic approach to concerns of commercialization, standardization, and governance of cloud computing applications.

•          Leverages the methods and tools of engineering in conceiving, developing, operating and maintaining cloud computing systems and solutions.

•          Uses the economics of cloud resources to solve business problems.

•          Looking for an experienced Azure Databricks ML Engineer with a strong background in machine learning model deployment.

•          The ideal consultant will have at least 7 years of experience and be proficient in PySpark, Python, and SQL.

•          A solid understanding of statistical analysis is a plus.

Responsibilities:

•          Design, develop, and deploy machine learning models using Azure Databricks.

•          Implement and manage Azure Databricks ML Flow for tracking and managing ML experiments.

•          Apply ML Ops best practices to ensure robust and scalable model deployment.

•          Deploy and manage Large Language Models (LLMs) and Generative AI (GenAI) models on Databricks.

•          Collaborate with Data Scientists and Engineers to integrate ML models into production environments.

•          Optimize and maintain existing ML models to ensure high performance and scalability.

•          Utilize PySpark, Python, and SQL for data processing and analysis.

•          Conduct statistical analysis to support data-driven decision-making.

•          Troubleshoot and resolve issues related to ML model deployment and performance.

•          Stay up-to-date with the latest advancements in machine learning and cloud technologies.

Required Technical Skills:

•          Experience with creating stored procedures in SQL.

•          Azure Databricks.

•          Azure Databricks Machine Learning Certificate

•          Bayesian Machine Learning

•          Machine Learning Operations

•          Pandas

•          PySpark

•          Quantitative Statistical Analysis

Qualifications:

•          10+ years of experience in ML model deployment using Azure Databricks.

•          Proficiency in PySpark, Python, and SQL.

•          Experience with Azure Databricks ML Flow and ML Ops best practices.

•          Experience with deploying and managing LLMs and GenAI models on Databricks.

•          Experience with statistical analysis is a plus.

•          Strong problem-solving skills and attention to detail.

•          Excellent communication and teamwork abilities.

•          Bachelor's Degree in Computer Science, Data Science, or a related field (Master's, preferred).

•          Achieved Azure Databricks Data Engineer Professional Certification

•          Azure Databricks Machine Learning Professional Certificate.

Regards,

Anshika Shukla

IT Recruiter

VSG Business Solutions Inc

3240 East State Street Extn Suite 203

Hamilton NJ 08619  

Anshika@vsgbusinesssolutions.com

https://www.linkedin.com/in/anshika-shukla-419b02239/