Tessera Labs

AI Infrastructure Engineer [Tooling]

Remote in the U.S.. Posted 16 days ago

The role

You will design, build, and own the tooling and services that take AI agents from a developer's laptop to production in customer clouds. This involves writing software in Python or Go and running it on Kubernetes alongside LLM serving stacks.

What you will do

  • Build and maintain internal CLIs, SDKs, and services in Python or Go
  • Deploy, scale, and tune LLM inference using vLLM and similar serving stacks
  • Build infrastructure for multi-agent systems including agent runtimes and sandboxing
  • Own MLOps workflows including model and prompt versioning and evaluation pipelines
  • Write Kubernetes operators and custom controllers
  • Design, build, and operate production-grade AI agent infrastructure on Kubernetes and Terraform
  • Support portable infrastructure across Azure, Oracle Cloud, GCP, and AWS
  • Improve observability for AI systems
  • Strengthen security and reliability for workloads in customer environments
  • Design and own CI/CD for infrastructure, services, and model/agent releases

Required qualifications

  • 5+ years of experience in infrastructure, platform, or backend engineering (7+ years for senior)
  • Strong software engineering in Python or Go
  • Track record of building and shipping tools, CLIs, or services
  • Hands-on experience running LLM workloads in production with vLLM or a comparable stack
  • Experience building infrastructure for AI agents or LLM applications
  • Practical MLOps experience
  • Strong hands-on experience with Kubernetes, including writing or extending operators/controllers
  • Strong hands-on experience with Terraform and at least one of Azure, Oracle Cloud, GCP, or AWS
  • Proven experience designing and owning CI/CD systems, GitOps-driven deployments, and release automation
  • Solid networking fundamentals
  • Proven experience deploying and operating real production systems

Nice to have

  • GPU infrastructure experience: NVIDIA GPU Operator, MIG, KServe, or Karpenter-style autoscaling
  • Familiarity with agent frameworks and protocols
  • LLM observability tooling such as OpenTelemetry, Langfuse, or Arize
  • Experience with FluxCD, ArgoCD, or other GitOps controllers
  • Cloud security and DevSecOps
  • Deep networking expertise
  • Open-source contributions to AI infrastructure or Kubernetes ecosystem projects
  • A passion for clean, unified infrastructure and a builder mindset

Benefits

  • Work on cutting-edge AI infrastructure with real enterprise impact
  • Own foundational systems at an early-stage, high-growth company
  • Collaborate with a sharp, execution-focused founding team
  • Shape how AI agents are deployed across the largest enterprise platforms in the world

About the company

Tessera Labs builds multi-agent AI systems that automate complex business workflows across platforms like SAP, Salesforce, Workday, Snowflake, and Databricks. They are backed by Foundation Capital and led by a world-class founding team.

AI Infrastructure Engineer [Tooling] at Tessera Labs | JobZoey