Prior Labs
ML Engineer, Backend
Berlin. Posted 13 months ago
The role
You will design, build, and scale core systems to bring foundation models to the world. You will work with AI researchers to translate models into scalable production systems.
What you will do
- Own the end-to-end serving path including latency, throughput, batching, memory behavior, and cost per prediction
- Design robust, scalable, and secure backend systems and production-grade APIs
- Develop high-quality, maintainable code for core backend services
- Design, deploy, and manage core infrastructure on cloud platforms
- Implement secure, GDPR-compliant systems including data storage, access control, usage tracking, and quota management
- Drive high standards for testing, CI/CD, documentation, and security
Required qualifications
- 3+ years of professional experience in machine learning and backend engineering
- Proven track record of managing production infrastructure
- Proven experience deploying and operating machine learning models in production
- Strong, hands-on experience designing and building production-grade APIs and backend services
- Significant experience building and operating services on cloud platforms
- Strong, hands-on experience with Infrastructure as Code (IaC) using tools like Terraform
- Significant experience with containerization and orchestration technologies (Docker, Kubernetes)
- Proficiency in Python
Nice to have
- Experience building or managing infrastructure specifically for machine learning (MLOps, model serving frameworks, feature stores, data pipelines)
- Deep experience with inference optimization (quantization, compilation, dynamic batching, caching strategies, interplay with distributed computing)
- Experience with PyTorch and FastAPI specifically
- Contributions to relevant open-source projects
- GCP preferred
About the company
Prior Labs is an independent frontier AI lab backed by SAP that pioneers tabular foundation models. The team is small and highly selective with backgrounds from Google, DeepMind, Meta, Apple, Amazon, Jane Street, and CERN.