Data Engineer (Databricks) || Remote || USC only
End-client: Highmark || Working with Prime Vendor
The Glider Assessment test will be there
Job Description:
This job takes the lead in providing complex application development services in Highmark’s Google Cloud Platform environment, typically as part of a project team or in an application support role. Databricks Engineers analyze, design, code, test, and implement more complex systematic solutions to meet customer requirements that adhere to Highmark IT standards and policies. They also provide general support to maintain more complicated applications that meet the service levels, system availability, performance, and quality levels their customers require. Able to guide and mentor less experienced team members.
Responsibilities:
- Takes a lead role in analyzing, designing, coding, testing, and implementing more complex application enhancements, providing general production support, and meeting defined scope, target dates, and budgets with minimal or no defects.
- Utilizes and participates in the more complex full system development life cycle, per current Highmark SDLC standards.
- Takes a lead role in collaborating with customers, business analysts, partners, and IT team members to understand business requirements that drive the analysis and design of quality technical solutions. Concentrates on providing innovative solutions to more complex business needs.
- Performs work in compliance with all Highmark and Highmark IT standards, policies, and procedures.
- Actively takes a leading role and participates on project teams in various project roles, including, but not limited to, Developer, Technical Lead, and Project Manager, based upon level of experience.
- Effectively communicates with team members, customers, partners, and management, including assisting with or conducting more complex technical walkthroughs, reporting project status, enabling vendor solutions, and providing accurate and concise documentation.
- Other duties as assigned or requested.
Required Qualifications:
- Bachelor’s degree in Information Technology, Computer Science or closely related field
- 5 years of experience as a developer
- 3 years of experience in Databricks technology and experience in working with Databricks notebooks, clusters, and jobs. They should be able to optimize and troubleshoot Databricks workflows.
- Deep understanding of Spark and its core concepts. They should be proficient in Spark programming Python, Pyspark
- Strong data engineering skills, including experience with data ingestion (batch and streaming), data transformation, and data quality validation. They should be familiar with ETL and have hands-on experience with data pipelines and data orchestration tools.
- Expertise with GCP, including services like Google Cloud Storage, BigQuery, Pub/Sub, and Dataflow.
- Problem-solving, root-cause analysis, and issue resolution
- Demonstrated leadership skills
- Experience in the Healthcare or Health Insurance Industry
- Experience with Databricks, GCP, application development tools, business processes, software development life cycle used by Highmark enterprise
Preferred Qualifications:
-
- Master’s degree in Information Technology, Computer Science or a closely related field
- 5 years of experience as a developer with demonstrated skills in:
- Databricks
- Python/Pyspark
- GCP: Big Query and PostgreSQL
- Certifications such as Python, Databricks, and GCP.
Akash Kumar
Recruitment Team Lead
Techcenter Technologies Incorporated
3240 East State Street Ext, Hamilton, New Jersey 08619
https://www.linkedin.com/in/akash-kumar-757b06131/
To unsubscribe from future emails or to update your email preferences click here