Blog

Azure Data Engineer 
Location – Remote
 

Job Description: 
We will focus on Azure Databricks, Python, Spark, Kafka and SQL as primary skill. We will make sure resource understands Azure security model. Resource will be working on  data integration (ETL), building data quality framework and do data reconciliation activities using DQ framework. Data will be stored in ADLS.

 

*SKILLS:*  
•    Mature the Senior Cloud Software Engineer mindset within the agile teams using techniques such as Acceptance Test Driven Development, Continuous Integration, and Continuous Delivery to provide quality products with seamless integration across Development, Quality Assurance, Infrastructure, Operations, and Release Management roles Servant leader who develops and supports a learning organization model through coaching, training, and mentorship. 
•    Can adapt as necessary for unintended consequences of this change initiative and understands the value of commitments to delivery made by a development team. 
•    Blogging and community support are a part of this role. Expected to work on both tactical and strategic assignments. 
•    Expected to handle the manual work while figuring out how to automate it. 
•    IT experience on web-based products • 
•    Agile methodologies and Test Driven Development • 
•    Continuous integration experience (for example tools like Jenkins, GitHub actions). • 
•    Expert knowledge in Python/Scala programming (Spark scripting, and API as a big PLUS) • 
•    Expert knowledge in Spark programming in Databricks (Spark SQL, Spark Streaming)  •  
•    Expert knowledge of Azure Data tools like ADF(Azure Data Factory),  • 
•    Knowledge of the AirFlow or other scheduling software • 
•    Knowledge of SQL and RDBMS concepts • 
•    Experience of programming for Kafka is a big PLUS. 
•    * Azure Cloud experience sufficient to perform as Azure Data Developer 
•    * Azure Cloud security model knowledge 
•    * Terraform or Bicep IaaS experience    
•    • 7 years of IT experience working on positions with hands on experience 
•    • 2 years of experience working on large scale, multiple team projects 
•    • 2 years of experience with Agile methodologies and Test-Driven Development 
•    • 2 years of continuous integration experience (for example tools like Jenkins, Anthill Pro). 
•    • 4 years of experience programming Python/Scala 
•    • 3 years of experience with programmatic interaction with a relational database.