Job Title: Senior Data Scientist (Predictive Analytics – Databricks)
Location: Remote
Job Summary:
We are looking for an experienced Senior Data Scientist with a strong focus on predictive analytics and Databricks to join our remote team. The ideal candidate will have hands-on expertise in building and deploying machine learning models, working with big data technologies, and collaborating cross-functionally to operationalize ML solutions. Experience in the Life Insurance or P&C insurance domain is highly desirable.
Key Responsibilities:
-
Design and implement predictive models such as churn prediction, time series forecasting, fraud detection, etc.
-
Build and deploy scalable ML pipelines on Databricks Lakehouse, including ingestion, transformation, model training, and inference.
-
Optimize models using AutoML, hyperparameter tuning, and MLflow for experiment tracking.
-
Deploy models via Databricks Jobs or REST APIs, supporting both batch and real-time inference.
-
Work with Delta Lake to ensure scalable, ACID-compliant data workflows.
-
Enable CI/CD for machine learning pipelines using Databricks Repos and GitHub Actions.
-
Troubleshoot performance issues in Spark jobs and ensure the reliability of the Databricks environment.
-
Collaborate closely with data engineers, platform teams, and business stakeholders to align models with business goals.
Required Qualifications:
-
5+ years of experience in predictive analytics, including regression, classification, time-series forecasting, clustering, and NLP.
-
Strong experience with Python, PySpark, SQL, and Databricks ML Runtime.
-
Hands-on expertise with MLflow, Databricks AutoML, Feature Store, and Unity Catalog.
-
Familiarity with cloud platforms such as Azure or AWS.
-
Experience in Life Insurance or Property & Casualty (P&C) industry is preferred.
-
Ability to work independently in a remote environment and deliver production-grade models.
Preferred Skills:
-
Strong understanding of Delta Lake, Spark SQL, and Databricks architecture.
-
Experience with CI/CD practices in data science workflows.
-
Familiarity with governance and model lifecycle management tools like Unity Catalog.
Certifications (Preferred):
-
Databricks Certified Machine Learning Practitioner (Optional but a plus)
To unsubscribe from future emails or to update your email preferences click here