Labelbox

Member of Technical Staff

San Francisco Bay Area. Posted a month ago

The role

You will own the design, development, and production of Frontier Data Products. You will build sandboxed, reproducible environments, terminals, browsers, and tool-augmented workspaces that AI agents use during training and evaluation.

What you will do

  • Design, build, and maintain sandboxed RL environments for agentic AI training
  • Develop reproducible, containerized execution environments
  • Integrate with and extend open-source agentic tooling and custom CLI/API harnesses
  • Build instrumentation and observability layers
  • Collaborate with data operations to design task curricula and evaluation protocols
  • Own environment deployment and reliability including CI/CD pipelines and monitoring
  • Rapidly prototype new environment types

Required qualifications

  • 2+ years of professional software engineering experience
  • Strong fundamentals in Python
  • At least one systems-level language (Go, Rust, C++)
  • Demonstrated experience with containerization and sandboxing (Docker, Podman, Firecracker, or similar) in production or near-production contexts
  • Familiarity with RL concepts: MDPs, reward shaping, episode structure, observation/action spaces
  • Experience building or maintaining developer tooling, CLI tools, or infrastructure automation
  • Comfort working with browser automation frameworks or terminal interaction tooling
  • Strong debugging instincts to trace failures across process boundaries, container layers, and network calls
  • Ability to read and implement from academic papers and open-source benchmark repositories

Nice to have

  • Direct experience building or contributing to RL environments (Gymnasium/Gym, PettingZoo, or custom environment implementations)
  • Experience with agentic AI evaluation frameworks (SWE-bench, WebArena, OSWorld, TerminalBench, or similar)
  • Familiarity with GCP or AWS infrastructure (Compute Engine, ECS/EKS, Cloud Build)
  • Prior work at an AI data company, ML platform company, or AI research lab
  • Contributions to open-source projects in the RL, agents, or dev-tools space

About the company

Labelbox builds critical infrastructure that powers breakthrough AI models at leading research labs and enterprises. The company offers integrated solutions including an Enterprise Platform & Tools, Frontier Data Labeling Service, and an Expert Marketplace.

Member of Technical Staff at Labelbox | JobZoey