Blog

Hi Team,

Please support on below position:

Position: Big Data Engineer with python

Location: Phoenix, AZ

Duration: Contract

Job Description:

• Designing, installing, testing, and maintaining scalable data management systems
• Ensuring systems meet business requirements and industry standards
• Integrating new data management tools into company ecosystems
• Creating custom software components and analytics applications
• Research data acquisition opportunities and new uses for existing data
• Developing data modeling, mining, and production processes

Roles and Responsibilities:

• 3+ years of industry experience in creating and managing end-to-end Data Solutions, Optimal Data Processing Pipelines and Architecture dealing with large volume, big data sets of varied data types.
• Proficiency in Python. Knowledge of design patterns, oops concepts and strong design skills in python.
• Strong knowledge of working with PySpark, Dataframes, Pandas Dataframes for writing efficient pre-processing and other data manipulation tasks.
• Experience with creating Restful web services and API platforms.
• Experience with SQL and NoSQL databases. E.g. Postgres/MongoDB/ Elasticsearch etc.
• Experience with stream-processing systems: Spark-Streaming, Kafka etc and working experience with event-driven architectures.
• Work with data science and infrastructure team members to implement practical machine learning solutions and pipelines in production.