Inferact

Member of Technical Staff, Product Security

San Francisco. Posted 10 days ago

The role

You will own the security architecture for the inference platform, APIs, control plane, data plane, and BYOC deployments. You will lead SOC 2 compliance, conduct enterprise security reviews, and act as the tech lead for vLLM vulnerability management.

What you will do

  • Own the security architecture of the inference platform and its APIs
  • Own the security architecture of the control plane and data plane
  • Own the security architecture of BYOC deployments
  • Own the security architecture of cloud and Kubernetes infrastructure
  • Advise on the design of the BYOC product
  • Lead SOC 2 and other compliance work
  • Act as the technical voice in enterprise security and IT reviews
  • Serve as the tech lead for vLLM vulnerability management
  • Set the direction for security at Inferact
  • Carry work from design review to shipped fix

Required qualifications

  • Deep, hands-on infrastructure security experience on production systems including cloud IAM, network segmentation, Kubernetes, secrets management, and infrastructure as code
  • Experience designing or reviewing multi-tenant and hybrid architectures including control plane and data plane separation, deployments into customer-owned cloud accounts, authentication, authorization
  • Hands-on experience taking a company through SOC 2 or a similar framework including building technical controls
  • Experience leading enterprise security and IT reviews
  • Strong software engineering ability to read and write production code, review pull requests, and ship fixes and tests
  • Experience as the technical lead for other security engineers
  • Sound risk judgment
  • Clear written and verbal communication with engineers, leadership, and customers' security teams

Nice to have

  • Experience building or securing a BYOC, managed-service, or customer-hosted product at a cloud infrastructure or data platform company
  • Experience securing AI / ML infrastructure, model serving, GPU workloads, or developer platforms
  • Experience running or leading a vulnerability management program
  • Experience securing software supply chains and CI/CD
  • Familiarity with security risks specific to inference systems
  • Credited CVEs, security fixes, or security tooling in widely used open-source infrastructure
  • Built a security and compliance function from the ground up at an early-stage infrastructure company
  • Offensive security or security research experience that you turned into lasting engineering fixes
  • Contributions to vLLM, PyTorch, or other inference and ML infrastructure projects

Benefits

  • Health benefits
  • Dental benefits
  • Vision benefits
  • 401(k) company match

Before you apply

  • We sponsor visas on a case-by-case basis

About the company

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress. Founded by the creators and core maintainers of vLLM, the company sits at the intersection of models and hardware.

Member of Technical Staff, Product Security at Inferact | JobZoey