Hello,
This is Pradeep from iTech US. We have a position for our client.
This is Pradeep from iTech US. We have a position for our client.
Azure Data Engineer with Data Ops and GenAI Engineer
Montvale, NJ (Day One Onsite)
12 Months
Montvale, NJ (Day One Onsite)
12 Months
Job Description:
Over 10 years of IT experience? 4+ recent years in Azure stack? 4+ years? experience with DataOps & CI/CD practices to enable automated building, testing, and deployment of data products and applications? 2+ years of experience in integrating with heterogenous sources using linked services.? 2+ years? experience enabling data governance capabilities and configuration in data engineering lifecycle (data privacy, data security & compliance, and data quality)? 2+ years integrating and nuances around maintaining GitHub and GitHub actions.? 2+ recent years in ADF creating pipelines with several activities? 2+ recent years of experience developing PySpark notebooks in Azure databricks cluster? 1+ years of hardcore experience with SparkSQL? 1+ years of relevant configuration experience in unity catalog integration and use? Strong experience with configuration and administration of Azure data platforms (Azure Data Factory, Azure Databricks, etc)? Support the strategy, planning, and implementation of data processing design and provide sizing and configuration assistance? Provide code review and facilitate code management for engineering team to ensure best practices and performance standards? 4 years in SDLC agile and using CI/ CD pipeline using Github actions.? 1+ years in deployment and post deployment activities in production.? 1+ year helping with standing the infrastructure stack and linked services with various sources.? Up to 1 year of Vectorization using OpenAI?s embedding scheme and storing data in vector database? Collibra/ purview experience is a big plus.
Over 10 years of IT experience? 4+ recent years in Azure stack? 4+ years? experience with DataOps & CI/CD practices to enable automated building, testing, and deployment of data products and applications? 2+ years of experience in integrating with heterogenous sources using linked services.? 2+ years? experience enabling data governance capabilities and configuration in data engineering lifecycle (data privacy, data security & compliance, and data quality)? 2+ years integrating and nuances around maintaining GitHub and GitHub actions.? 2+ recent years in ADF creating pipelines with several activities? 2+ recent years of experience developing PySpark notebooks in Azure databricks cluster? 1+ years of hardcore experience with SparkSQL? 1+ years of relevant configuration experience in unity catalog integration and use? Strong experience with configuration and administration of Azure data platforms (Azure Data Factory, Azure Databricks, etc)? Support the strategy, planning, and implementation of data processing design and provide sizing and configuration assistance? Provide code review and facilitate code management for engineering team to ensure best practices and performance standards? 4 years in SDLC agile and using CI/ CD pipeline using Github actions.? 1+ years in deployment and post deployment activities in production.? 1+ year helping with standing the infrastructure stack and linked services with various sources.? Up to 1 year of Vectorization using OpenAI?s embedding scheme and storing data in vector database? Collibra/ purview experience is a big plus.
Thanks & Regards,
Pradeep.
Pradeep.
To unsubscribe from future emails or to update your email preferences click here