Fireworks

Member of Technical Staff, Cloud Infrastructure

San Mateo, Remote. Posted 17 months ago

The role

You will architect and build backend infrastructure to support distributed training, inference, and data processing pipelines. You will design core backend services and optimize infrastructure across compute, storage, and networking layers.

What you will do

  • Architect and build scalable, resilient, and high-performance backend infrastructure.
  • Lead technical design discussions and mentor other engineers.
  • Design and implement core backend services like job schedulers and autoscalers.
  • Drive infrastructure optimization initiatives for cost, storage, and network performance.
  • Collaborate cross-functionally with ML, DevOps, and product teams.
  • Evaluate and integrate cloud-native and open-source technologies.
  • Own end-to-end systems from design to deployment and observability.
  • Ensure systems are designed with high availability, scalability, and performance.
  • Develop and maintain monitoring, alerting, logging, and tracing solutions.

Required qualifications

  • Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience).
  • 5+ years of experience designing and building backend infrastructure in cloud environments (e.g., AWS, GCP, Azure).
  • Proven experience in ML infrastructure and tooling (e.g., PyTorch, TensorFlow, Vertex AI, SageMaker, Kubernetes, etc.).
  • Strong software development skills in languages like Python, or C++.
  • Deep understanding of distributed systems fundamentals: scheduling, orchestration, storage, networking, and compute optimization.

Nice to have

  • Master’s or PhD in Computer Science or related field.
  • Experience leading infrastructure projects supporting large-scale ML/AI workloads or high-throughput systems.
  • Familiarity with infrastructure-as-code and CI/CD tooling (e.g., Terraform, ArgoCD, GitOps).
  • Track record of driving system performance, reliability, and cost-efficiency improvements.
  • Contributions to open-source cloud or ML infrastructure projects

About the company

Fireworks is a platform for specialized intelligence that enables companies to build, train, and serve AI models. It is a Series D company valued at $17.5 billion.