Inferact
Member of Technical Staff, Product Security
San Francisco. Posted 10 days ago
The role
You will own the security architecture for the inference platform, APIs, control plane, data plane, and BYOC deployments. You will lead SOC 2 compliance, conduct enterprise security reviews, and act as the tech lead for vLLM vulnerability management.
What you will do
- Own the security architecture of the inference platform and its APIs
- Own the security architecture of the control plane and data plane
- Own the security architecture of BYOC deployments
- Own the security architecture of cloud and Kubernetes infrastructure
- Advise on the design of the BYOC product
- Lead SOC 2 and other compliance work
- Act as the technical voice in enterprise security and IT reviews
- Serve as the tech lead for vLLM vulnerability management
- Set the direction for security at Inferact
- Carry work from design review to shipped fix
Required qualifications
- Deep, hands-on infrastructure security experience on production systems including cloud IAM, network segmentation, Kubernetes, secrets management, and infrastructure as code
- Experience designing or reviewing multi-tenant and hybrid architectures including control plane and data plane separation, deployments into customer-owned cloud accounts, authentication, authorization
- Hands-on experience taking a company through SOC 2 or a similar framework including building technical controls
- Experience leading enterprise security and IT reviews
- Strong software engineering ability to read and write production code, review pull requests, and ship fixes and tests
- Experience as the technical lead for other security engineers
- Sound risk judgment
- Clear written and verbal communication with engineers, leadership, and customers' security teams
Nice to have
- Experience building or securing a BYOC, managed-service, or customer-hosted product at a cloud infrastructure or data platform company
- Experience securing AI / ML infrastructure, model serving, GPU workloads, or developer platforms
- Experience running or leading a vulnerability management program
- Experience securing software supply chains and CI/CD
- Familiarity with security risks specific to inference systems
- Credited CVEs, security fixes, or security tooling in widely used open-source infrastructure
- Built a security and compliance function from the ground up at an early-stage infrastructure company
- Offensive security or security research experience that you turned into lasting engineering fixes
- Contributions to vLLM, PyTorch, or other inference and ML infrastructure projects
Benefits
- Health benefits
- Dental benefits
- Vision benefits
- 401(k) company match
Before you apply
- We sponsor visas on a case-by-case basis
About the company
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress. Founded by the creators and core maintainers of vLLM, the company sits at the intersection of models and hardware.