Senior AI/ML Ops Engineer-II (Hybrid in Bangalore)

The role

You will design, develop, and oversee the strategy and architecture of scalable and reliable AI/ML Ops platforms and pipelines. This role involves deploying AI/ML services, managing infrastructure, and automating workflows to bridge the gap between model development and production.

What you will do

• Designing, Developing and overseeing the strategy and architecture of scalable and reliable AI/ML Ops platforms / pipelines
• Package and deploy AI/ML services to production
• Design and implement automated CI/CD pipelines
• Provision and optimize infrastructure for training and serving using Docker, Kubernetes, or serverless platforms
• Implement post-deployment monitoring for model performance, data drift, and latency
• Automate retraining and data pipeline workflows
• Manage the deployment of foundation models, fine-tuning workflows, and Retrieval-Augmented Generation (RAG) stacks
• Manage GPU/CPU utilization to minimize cloud costs
• Work closely with data scientists, data engineers, and software engineers
• Manage versioning for data, code, and models using tools like MLflow

Required qualifications

• Enterprise SaaS software solutions with high availability and scalability
• Solution handling large scale structured and unstructured data from varied data sources
• Experience in building and maintaining AI/ML Ops platform systems ensuring scalability, reliability, efficiency and security
• Working with Product engineering team to influence designs with data, AI and analytics use cases in mind
• In depth experience in System design, AI/ML Frameworks and tools involving large Petabytes of data with Databricks Lakehouse ecosystem
• AI/MLOps workflows on Databricks , MLFlow, Mosaic AI Agent Framework, Unity Catalog, Vector Search, Knowledge Graph
• Knowledge of AI/ML frameworks like LangChain, LangGraph for AI/ML Ops pipeline integration
• Hands-on experience with at least one major cloud provider (AWS, Azure, or GCP)
• Programming languages like Python and SQL
• Modern software engineering practices like Kubernetes, CI/CD, IAC tools, Observability, monitoring and alerting
• Solution Cost Optimisations and design to cost

Nice to have

• Experience in Monte Carlo is preferable
• Experience with AWS Bedrock is preferable
• Experience in AWS hosted data platform is preferable
• Terraform is preferably used for IAC tools

Before you apply

• Legally eligible to work in India on an ongoing basis

About the company

Smartsheet empowers teams to manage work seamlessly and scale solutions smarter. The India Global Capability Center delivers product innovation and enterprise capabilities to accelerate global growth.