Senior ML Platform Engineer (GenAI Platform)

The role

You will design and build systems behind production GenAI workloads. You will drive the expansion of the GenAI Platform and turn engineering needs into self-service capabilities.

What you will do

• Architect unified gateway with automated routing, quota controls, and resilient fallback systems.
• Drive system efficiency and low latency via traffic management, caching, and cost controls.
• Establish evaluation mechanisms for model output precision, stability, and safety.
• Deliver system observability including tracing, telemetry, cost analytics, and monitoring.
• Standardize prompt engineering workflows with versioning, testing, and CI/CD integrations.
• Embed platform guardrails to enforce policies and safe production defaults.
• Maintain sustainable incident response, blameless postmortems, and monitoring.

Required qualifications

• 5+ years designing, building and operating backend services or ML infrastructure handling production traffic.
• Strong Python skills and experience building developer-facing APIs/SDKs or shared libraries.
• Practical experience with GenAI systems, including vector retrieval, external provider APIs, and common issues.
• AI Expertise as a forefront user of Agentic AI.
• Sound knowledge of distributed systems, including high availability, concurrency, caching and rate limiting.
• Experience with at least one major public cloud, its services and infrastructure.
• Hands-on experience with distributed tracing, system telemetry, SLOs, and incident triage.
• Strong communication skills.
• C1 English level.
• Willingness to join a paid on-call rotation.

Nice to have

• Experience operating AI gateways or scalable model serving infrastructure.
• Familiarity with evaluation suites, prompt management, vector databases, or customized GenAI observability tooling.
• Experience with Metaflow, Databricks, or AWS SageMaker.
• Knowledge of hosting open-source foundation models, optimizing GPU compute, dynamic scaling, and infrastructure cost controls.
• Familiarity with agentic workflows, multi-agent frameworks and tool-use patterns.

Benefits

• Open, collaborative, dynamic, and diverse culture.
• Generous monthly allowance for lessons on Preply.com.
• Learning & Development budget, including time off for your self-development.
• Competitive financial package with equity and leave allowance.

About the company

Preply is a category-defining company that helps people discover tutors and craft personalised learning journeys. It has reached unicorn status with a $150M Series D.