Blog

San Jose, CA

Skills, Roles and Responsibilities (Google/AWS/Azure public cloud, PySpark, Big Query and Google Airflow)

• Participate in 24x7x365 SAP Environment rotational shift support and operations
• As a team lead you will be responsible for maintaining the upstream Big Data environment day in day out where millions of finanacial data flowing through, consists of PySpak, Big Query , Datgaproc and Google Air flow
• Will be responsible for streamlining and tuning existing Big Data systems and pipelines and building new ones. Making sure the systems run efficiently and with minimal cost is a top priority
• This role involves providing day-to-day support, enhancing platform functionality through DevOps practices, and collaborating with application
• Architect and optimize data warehouse solutions using BigQuery to ensure efficient data storage and retrieval. Manage and configure BigQuery.

click here