Illumio

Sr. Engineering Manager, Analytics and Applied AI

HQ - Sunnyvale (Office). Posted 2 months ago

The role

You will lead and grow a team of backend engineers building scalable cloud services and AI-powered platform capabilities. You will drive technical strategy for distributed systems, platform APIs, and AI-enabled services.

What you will do

  • Lead and grow a team of backend engineers building highly scalable cloud services and AI-powered platform capabilities.
  • Drive technical strategy and execution for distributed systems, platform APIs, and AI-enabled services.
  • Partner closely with Product, Security, Infrastructure, and Data Science teams to deliver intelligent platform experiences.
  • Define architecture for large-scale microservices, event-driven systems, and cloud-native applications.
  • Help shape Illumio's AI roadmap, including agentic workflows, LLM integrations, RAG architectures, and AI infrastructure.
  • Establish engineering best practices around reliability, observability, scalability, security, and operational excellence.
  • Mentor engineering managers and senior engineers while fostering a culture of ownership and innovation.
  • Drive quarterly planning, staffing strategy, technical roadmaps, and architectural reviews.
  • Ensure successful delivery of highly available services running across AWS, Azure, and GCP environments.

Required qualifications

  • 10+ years building distributed and scalable backend systems.
  • 3+ years leading software engineering teams and engineering leads/managers.
  • Strong experience in Java, Go, Python, or equivalent backend technologies.
  • Deep expertise with microservices, APIs, cloud-native architectures, Kubernetes, and containerized workloads.
  • Experience building high-scale distributed systems and event-driven architectures leveraging technologies such as Kafka.
  • Practical understanding of modern AI systems, including LLMs, AI agents, RAG architectures, model serving, prompt engineering, and agent orchestration frameworks.
  • Experience partnering with Product Management to define strategy and deliver customer-facing capabilities.
  • Strong communication skills and the ability to influence technical direction across organizations.
  • Experience operating services in production with a focus on telemetry, monitoring, and reliability.

Nice to have

  • Experience leading AI Platform, ML Infrastructure, or Agentic Systems teams.
  • Hands-on knowledge of vector databases, inference optimization, model evaluation frameworks, and AI observability platforms such as Langfuse.
  • Security or cybersecurity domain experience.
  • Experience building enterprise SaaS platforms at scale.
  • Familiarity with Terraform, cloud automation, and Infrastructure-as-Code.

Before you apply

  • Job offer is contingent upon the applicant's capacity to serve in compliance with U.S. export controls.
  • Job offer is contingent upon completing a background check through an authorized third-party vendor.

About the company

Illumio is the leader in ransomware and breach containment, redefining how organizations contain cyberattacks and enable operational resilience. The company enables Zero Trust, strengthening cyber resilience for infrastructure, systems, and organizations.

Sr. Engineering Manager, Analytics and Applied AI at Illumio | JobZoey