Blog

Hi All

Please share the updated profile to [email protected]

Lead Big Data Engineer (GCP) – UST Global

Role: Senior Data Engineer with GCP

• Location: Sunnyvale, CA

Description:

UST Global® is seeking a highly energetic and collaborative Senior Data Engineer for a 12-month engagement. This role requires extensive experience in Google Cloud Platform (GCP) and big data technologies.

Mandatory Areas

Must Have Skills:

• GCP Experience: 2+ years of recent experience with GCP, including Dataproc, Google Cloud Storage (GCS), and BigQuery.
• Big Data Technologies: 5+ years of hands-on experience with Hadoop, Hive, Spark, and Airflow.
• Programming Languages: Proficiency in Python, Java, and Scala.

Responsibilities:

• Design & Development: Design and develop big data applications using the latest open-source technologies.
• Data Modeling: Develop logical and physical data models for big data platforms.
• Workflow Automation: Automate workflows using Apache Airflow.
• Pipeline Creation: Create data pipelines using Apache Hive, Apache Spark, and Apache Kafka.
• Maintenance & Support: Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support.
• Knowledge Sharing: Learn the business domain and technology infrastructure quickly and share knowledge with the team.
• Mentorship: Mentor junior engineers on the team.
• Leadership: Lead daily standups and design reviews.
• Backlog Management: Groom and prioritize backlog using JIRA.
• Domain Expertise: Act as the point of contact for your assigned business domain.

Requirements:

• GCP Experience: 2+ years of recent experience building data pipelines in GCP with Dataproc, GCS, and BigQuery.
• Big Data Platforms: 5+ years of hands-on experience with Hadoop, Hive, Spark, and Airflow.
• Schema Modeling: 2+ years of experience modeling and designing schema for data lakes or RDBMS platforms.
• Programming & Scripting: Experience with Python, Java, Scala, Perl, and Shell.
• Data Management: Experience working with large data sets (multi TB/PB scale).
• Testing & Methodologies: Exposure to test-driven development, automated testing frameworks, and Scrum/Agile methodologies.
• Communication Skills: Excellent verbal and written communication skills.
• Education: Bachelor’s Degree in Computer Science or equivalent experience.

Desired Experience:

• Version Control: Gitflow.
• Atlassian Products: Experience with BitBucket, JIRA, Confluence.
• CI Tools: Familiarity with Continuous Integration tools like Bamboo, Jenkins, or TFS.

Location & Pay Rate:

• Sunnyvale, CA

Alternate Location & Pay Rate:

• Bentonville, AR

Regards

[email protected]