|
Hi,
Please look at the requirements below, let us know of your interest, and send us your updated resume to [email protected]
SRE/Lead DE with Azure
Remote (PST time zone)
Must Have Skills
Skill 1 – Yrs of Exp – 6+ Experience with Azure platform ecosystem products such as: Synapse, ADF, Azure Active Directory, Data Lake Storage (ADLS)
Skill 2 – Yrs of Exp – 6 + Experience with one or more ETL platforms: ADF, NiFi, Alteryx, SSIS
Skill 3 – Yrs of Exp – 6+ Experience in one or more of: Java, Perl, Python, PowerShell, groovy, bash
Skill 4 – Yrs of Exp – 6+ Experience with one or more databases: SQL Server, ADW, Postgres
Skill 5 – Yrs of Exp – 6+ Experience with Jira, Git, Azure DevOps, CI/CD
Job descriptions for the Sr data engineering
We operate in an Azure + Databricks Lakehouse. We’ll need a person with:
• Azure experience – ADF for orchestration, ADLS for storage, Azure DevOps for CI/CD
• Databricks experience – all compute/ETL leverages Databricks and is programmed leveraging Spark (PySpark, Spark SQL)
• PowerShell experience – this is our scripting language of choice
• SQL proficiency – it’s used everywhere (TSQL, PostgreSQL)
• Proficiency with parquet and delta formats
Additionally – they will need experience in:
• SDLC + CI/CD – we follow a standard deployment process (dev, test, prod) that includes peer reviewed code. They need to be comfortable with standard DevOps practices.
• Should have a deep understanding of indexes and partitioning.
• Should be proficient optimizing code for performance (able to read a DAG, determine where CBO is using most resources)
• Should be proficient in writing code in a matter that it can run repeatedly and produce the same state (we have a custom SQL Deployment framework)
With Regards
Siva Kishore
[email protected]
Siva Kishore | LinkedIn
|
