Job Title: Kafka Developer Lead
Location: Rosemont, IL (Onsite)
Duration: Long-Term Contract
Education Requirements: Bachelor’s degree (or equivalent) in a relevant technical field
Passport Number is mandatory
10+years profile
Job Description:
Position Overview: The Kafka Developer Lead will be responsible for designing, developing, and deploying a Confluent Kafka platform for enterprise use. This role requires extensive experience with Kafka technology, including Confluent Kafka and Confluent Cloud, as well as a strong background in Java, Spring Boot, and distributed systems. The successful candidate will lead the technical implementation of Kafka solutions, ensuring robust, scalable, and high-performance streaming and messaging systems.
Key Responsibilities:
- Architect and design a Confluent Kafka platform from the ground up for enterprise use.
- Develop, configure, and deploy end-to-end Kafka solutions, including integration with source and target systems.
- Build and manage Kafka Streams pipelines and clusters, including hands-on development with Kafka API to create producer and consumer applications.
- Design and implement KSQL queries and decide best practices for using KSQL versus KStreams.
- Develop and operationalize new Kafka Connectors, utilizing frameworks and various connector types (HTTP REST proxy, JMS, File, SFTP, JDBC).
- Monitor Kafka infrastructure and related components (Connectors, KStreams, producer/consumer apps), ensuring high performance and reliability.
- Work with data formats such as XML, JSON, Avro, CSV, and serialization/deserialization options, including familiarity with Schema Registry.
- Provide technical leadership and guidance on Kafka architecture and internals, including brokers, Zookeeper, producers/consumers, Kafka Connect, and Kafka Streams.
- Collaborate with stakeholders to ensure alignment with business requirements and integration needs.
- Utilize Confluent Control Center for monitoring and managing Kafka infrastructure.
Required Technical Experience:
- 12+ years of experience in the software industry.
- 8+ years of experience in Enterprise Middleware, Microservices, and API design/implementation.
- 5+ years of experience architecting, designing, implementing, and operating streaming platforms based on Confluent Kafka and Confluent Cloud.
- 5+ years of experience with Java and Spring Boot.
- Strong fundamentals in distributed systems design, microservice architecture, and integration patterns.
- Proven track record with Kafka technology, including hands-on production experience and deep understanding of Kafka architecture and components.
- Practical experience in scaling Kafka, KStreams, and Connector infrastructures.
- Experience with Kafka Streams / KSQL architecture, including clustering models.
- Expertise in developing KStreams pipelines and deploying KStreams clusters.
- Strong knowledge of the Kafka Connect framework and experience with various connectors and source/sink connectors (RDBMS, NoSQL data stores).
- Familiarity with data formats and serialization/deserialization, including Schema Registry.
- Experience in monitoring Kafka infrastructure and related components.
Desired Competencies:
- Experience in the banking/financial services industry with a firm understanding of the banking data landscape.
- Excellent written and verbal communication skills.
- Strong analytical and troubleshooting abilities.
- Understanding of the systems development lifecycle (SDLC).
Best Wishes,
Sai Kumar | IT Recruiter|
Email : [email protected] | Consulting Knights, Inc
Princeton Forrestal Village, 116 Village Blvd. Suite # 200, Princeton, NJ 08540
Linkedin: linkedin.com/in/sai-kumar-b25826264
Disclaimer: This is not meant to be an unsolicited email, So If you want to be removed, please reply with REMOVE in the Subject & I will promptly remove upon receipt)