Blog

Apache Spark

Location – Remote

10+ Years Consultant

Job Description:

Must Have –  Develop big data processing systems using Apache Spark, Airflow, Databricks, AWS and related technologies. Fluency in one or more languages like Scala (preferred), Java, Python. Familiar with CI/CI Pipelines, ETL pipelines, containerization

Good to have – Experience using web service APIs.  Knowledge of microservices and scaling techniques

• 8+ years of hands-on experience with Apache Spark, Airflow, Databricks, AWS and related technologies.

• Fluency in one or more languages like Scala (preferred), Java, Python.

• Knowledge and experience on Jenkins for CI/CD automations. DevOps knowledge is added advantage

• Nice to have experience using web service APIs.  Knowledge of microservices and scaling techniques.

• Strong analytical skills

• Must follow the guideline, process, and best practices of Agile development

• Good written and verbal communication skills