Zscaler

Senior AI Platform Engineer

Pune, IND. Posted 2 days ago

The role

You will design, build and maintain scalable, secure and highly available AWS infrastructure for AI/ML workloads, using Terraform. You will own GitLab CI/CD pipelines, observability with Prometheus and Grafana, and DORA metrics. You will also partner with AI/ML teams and mentor engineers.

What you will do

  • Design, build and maintain scalable, secure and highly available AWS infrastructure (EKS, Lambda, ECS, VPC, IAM) for AI/ML workloads using Terraform best practices.
  • Own and evolve GitLab CI/CD pipelines for AI platform services to enable fast, reliable and repeatable releases.
  • Architect a centralized observability stack using Prometheus and Grafana, with golden-signal dashboards and intelligent alerting.
  • Define and track DORA metrics to drive delivery and reliability improvements.
  • Build self-healing, auto-scaling and cost-optimized infrastructure for AI/ML services on Kubernetes.
  • Implement infrastructure security best practices and establish platform governance standards.
  • Partner on production-grade AI/RAG deployments with AI/ML and data teams.
  • Mentor junior and mid-level engineers.

Required qualifications

  • Foundational understanding of AI/ML technologies and experience leveraging, securing or positioning AI-driven solutions.
  • 4+ years as a Platform, SRE or DevOps Engineer, including 1+ years supporting AI/ML or data platform infrastructure.
  • Deep hands-on AWS skills (EKS, Lambda, ECS, VPC, IAM, S3).
  • Strong hands-on experience with Terraform (modules, workspaces, remote state) and designing or maintaining GitLab CI/CD pipelines with runners.
  • Proven expertise in Prometheus and Grafana (custom exporters, dashboards, alerting) and tuning alerting systems (Alertmanager, PagerDuty, OpsGenie).
  • Solid understanding of DevOps/DORA metrics (deployment frequency, lead time for changes, change failure rate, MTTR).
  • Experience operating containerized apps on Kubernetes (EKS, Helm, Karpenter/HPA).
  • Strong scripting skills in Python (and/or Go/Bash).
  • Excellent communication skills.

Nice to have

  • Proven ability to leverage AI technologies and workflows to drive measurable operational efficiency.
  • Experience with LiteLLM (multi-region deployments), Ray.io/Anyscale, Temporal and agentic frameworks (LangGraph, LangChain or LlamaIndex).
  • Working knowledge of vector databases (Qdrant, Pinecone, Weaviate), ZEP, MLOps practices (MLflow/Kubeflow) and LLM observability (Arize Phoenix).
  • Exposure to GitOps (ArgoCD/Flux), log aggregation and tracing (Loki, ELK, Jaeger/Tempo), FinOps and security compliance frameworks (SOC 2, ISO 27001).

Benefits

  • Various health plans
  • Time off plans for vacation and sick time
  • Parental leave options
  • Retirement options
  • Education reimbursement
  • In-office perks

Before you apply

  • The company complies with applicable pay transparency rules, and it provides accommodations in its recruiting process on request.
  • By applying, you agree to follow applicable laws, regulations and company security and privacy policies.

About the company

Zscaler (NASDAQ: ZS) provides a cloud security platform, the Zero Trust Exchange, that connects users, devices and applications securely. The company says it is building an AI-native enterprise.