|
Job Title: Lead AWS Data Engineer
Job Location: Newark, NJ 07102 (Hybrid)
Contract Duration: 12+ Right to hire role
Level 3 (5 to < 10 Year)
Notes:
- About the team
- EDP corporate team, we are basically in aws cloud shop and we primarily work on the AWS platform along with Python, pyspark and Blue. So these are the common skill sets used in our Aws development platform
- There is a panel that reviews technical solutions suggested before they get implemented
- Technology group within CDO
- Difference between this role and the previous one
- Lead data engineer from a development background but with business knowledge and language
- we are looking for senior candidate who will be able to have a conversation with the business team, understand their technical requirements, and be able to bring it back to the team and advise the team on our technical solution
- Also give some guidelines to the team saying that, hey, this is the solution and this is how we implement it and these aws components will be involved.
- 2-3 members who are full stack developers as direct reports
- AWS solutions architect certified is nice to have
- Batch and other methodologies is helpful
- Gaps with candidates so far
- ABS background missing
- Use of AWS, python, pyspark, glue job missing
- Not being able to explain the business problem and technical solutions
- Haven’t led a team on their own
- Haven’t created a solution on their own
- Candidate should be able to answer a question in this way:
- Business Problem: The organization is currently using a legacy system. The legacy system has several implications, including outdated technology, performance issues, and limited analytical capabilities. Some business teams are affected by these pain points.
- Proposed Solution: To mitigate these issues, the recommendation is as follows: Extract data from the legacy system, potentially in a file format. Transfer this data to cloud systems. Create a reusable or configuration-driven framework to transform and load data into the cloud. Once in the cloud, reformat the data for analytical purposes.
- Conversion to permanent is highly likely because of long term projects of different teams collaborating
- Business language / knowledge is key
- Platform is prebuilt. Candidate just needs to connect the dots to find the technical solution for the business problem. Give time frames, etc.
- Project manager with development background, aws background, who can architect.
- Will not code anything.
- Leadership experience
- Two interviews
- They will start asking the business and leading questions in the first interview now. The technical deep dive will happen in the second interview.
- Will happen in a few days of each other.
- Hybrid
At-a-Glance:
Are you ready to build your career by joining a global financial company? If so, our client is hiring a Lead AWS Data Engineer!
What You’ll Do:
- Help lead the team in designing, building and maintaining efficient, reusable, and reliable architecture and code in AWS.
- Meet with the business to understand their technical requirements, and be able to bring it back to the team and advise them on which technical solution will meet the business requirement.
- Ensure the best possible performance and quality of high scale web applications and services.
- Design and build highly performant function-based API’s.
- Ensures all code has been unit tested prior to QA, including interfaces with other systems.
What You Bring:
- Bachelor’s degree in Computer Science, similar technical field, or equivalent professional experience.
- 5+ years of experience as Full stack developer.
- Experience developing web applications is a must have.
- Experience with Python, Pysaprk, and Glue is a must have.
- Excellent experience with AWS Services – API Gateway, Lambda, Step Functions, SQS.
- Proven experience leading a development team.
Experience with some of the following:
- writing python/ Java nodeJS code for Lambda function
- developing business applications using NoSQL/ SQL databases
- working with Object stores(S3) and JSON is must have
- integrating SSO/LDAP/AD is a must have
- working with REST API’s, code packages, deployment tools
- DynamoDB, S3, ElasticSearch
- Serverless application development using AWS Lambda
- FE technologies like React JS
- BE development (microservices/APIs)
- Experience in metadata capture/discovery tools like CKAN a big plus.
- Experience integrating with third party tools is a must have.
- Experience in CI/CD, DevOps is a must have.
- AWS Solution Architect certified is a big plus.
|