Technical Lead Manager - Platform Engineering

The role

You will own engineering execution, technical direction, hiring, and team development. You will work with company leadership and product teams to decide what to build and how to deliver it reliably to customers.

What you will do

• Lead and develop the engineering team by setting priorities, ownership, and accountability.
• Partner with leadership to translate customer needs into a roadmap.
• Stay involved in architecture, code reviews, production debugging, and implementation.
• Set technical direction across application services, APIs, data pipelines, and ML infrastructure.
• Work with ML engineers and researchers on model training, fine-tuning, evaluation, and deployment.
• Guide model serving decisions regarding latency, throughput, GPU utilization, capacity, reliability, and cost.
• Improve engineering practices for testing, observability, security, incident response, and releases.
• Hire engineers, coach technical leaders and managers, and build a culture of direct communication.

Required qualifications

• Experience leading multiple engineering teams in B2B SaaS at a scope comparable to a 20–30-person organization.
• Strong, current hands-on engineering skills in reading and writing production code, reviewing architecture, and diagnosing technical problems.
• Practical familiarity with model serving and model training, including training or fine-tuning workflows, evaluation, deployment, and production operations.
• Understanding of tradeoffs between model quality, latency, throughput, GPU resources, reliability, and cost.
• Strong background in backend systems, APIs, distributed systems, and cloud infrastructure.
• Track record of hiring and developing engineers, setting expectations, and giving constructive feedback.
• Good product judgment regarding speed versus correctness, reliability, and security.
• Clear written and verbal communication with technical teams, customers, and company leadership.

Nice to have

• Experience scaling engineering at a Series A–C startup.
• Experience with document processing, OCR, extraction, retrieval, indexing, or other systems that work with enterprise data.
• Experience with LLMs or multimodal models, evaluation datasets, and model quality monitoring.
• Experience with GPU infrastructure, distributed training, inference optimization, or model serving frameworks.
• Experience building developer tools or API-first products.
• Experience with enterprise requirements such as multi-tenancy, access controls, auditability, and security reviews.
• Experience developing engineering managers while staying closely involved in technical execution.

Before you apply

• Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
• LlamaIndex does not accept unsolicited agency resumes.

About the company

LlamaIndex makes enterprise data useful for AI applications.