Blog

Hi,

AI/ML Ops Engineer

Hybrid to Hartford, CT

Visa : USC/ GC

Position Overview

AI/ML Ops Engineer to operationalize and manage machine learning pipelines leveraging

AWS Bedrock, Anthos, and open-source Retrieval-Augmented Generation (RAG)

technologies. This role focuses on automating infrastructure, ensuring model reliability, and building robust ML Ops workflows for scalable, secure, and fault-tolerant AI solutions. If you are passionate about optimizing AI systems in hybrid and multi-cloud environments, this position is for you.

Key Responsibilities

• Automation and Deployment:
• Automate the deployment, scaling, and monitoring of ML models in cloud and hybrid environments.
• Build and maintain ML Ops pipelines for RAG applications, integrating
• LlamaIndex for seamless data orchestration.
• Infrastructure Management:
• Use Boto3 to provision and manage AWS resources.
• Ensure high availability and fault tolerance of AI/ML infrastructure.
• Monitoring and Optimization:
• Implement real-time monitoring and optimize inference workloads using
• CloudWatch, Prometheus, and Grafana.
• Versioning and Tracking:
• Set up data versioning, model tracking, and lifecycle management using DVC and ML flow.
• Security and Compliance:
• Manage IAM policies to ensure secure and controlled access to resources.
• Ensure all workflows align with security best practices.
• DevOps Integration:
• Design and manage CI/CD pipelines using Git and GitHub Actions.
• Implement GitOps practices using tools like Flux and ArgoCD.
• Troubleshooting and Support:
• Diagnose and resolve issues in AI/ML infrastructure to minimize downtime and performance bottlenecks.

Required Technologies and Skills Cloud Platforms:

AWS (Bedrock, SageMaker, CloudWatch), Anthos

Containerization:

Docker, Kubernetes, Istio

MLOps Tools:

Kubeflow, MLflow, BentoML

RAG Stack:

LangChain, LlamaIndex, Haystack, Milvus

Version Control & Workflows:

Git, GitHub Actions, GitOps (Flux, ArgoCD)

Observability Tools:

Prometheus, Grafana, CloudWatch

Programming Languages:

Python (including Boto3), YAML, Bash

DevOps Practices:

CI/CD pipelines, Git-based workflows

Thanks & Regards,

Sandeep Kumar

Bench Sales Recruiter

Zuven Technologies Inc

2222 West Spring Creek PKWY,

Suite 102, Plano, TX -75023

Fax: 469 718 0405

Email: [email protected]

Website: www.zuventech.com

Follow me on   linkedin.com/in/sandeep-kumar-143b3b245

Note: We respect your online privacy. This is not unsolicited mail. Under Bill 1618 Title III passed by the 105th US Congress, this mail cannot be considered Spam as long as we include contact information and a method to be removed from our mailing list. If you are not interested in receiving our e-mails then please reply with a “REMOVE” in the subject line. I am sorry for the inconvenience caused to you