Senior AI/ML Backend Engineer

The role

You will be part of a team building the backend services for Lyra's machine learning and generative AI product features. You will create scalable, resilient backend infrastructure and deploy and manage applications in production, and you will be coding every day.

What you will do

• Build machine learning and generative AI backend services that support many ML/AI product features
• Create backend infrastructure that is scalable, resilient and highly performant
• Deploy and manage various applications in production
• Code every day

Required qualifications

• 6+ years of experience delivering production ready products
• Ability to write high-quality code in Python
• Experience with modern async Python web frameworks (e.g., FastAPI) and handling data streaming (WebSockets, Server-Sent Events)
• Experience working with Docker and deploying applications to Kubernetes
• Experience with relational and low-latency databases
• Experience integrating RAG (retrieval-augmented generation) into AI features
• Experience building generative AI chatbots
• Experience with LLM observability and monitoring tools (e.g., Langfuse) to track latency, token usage, and output quality
• Familiarity with LLM orchestration frameworks (e.g., LangChain, LlamaIndex) and integrating with foundation model APIs (e.g., OpenAI, Anthropic, AWS Bedrock)
• A desire to learn new technologies quickly
• A love of building systems from scratch
• A thoughtful approach to balancing quality and deadlines in fast-paced settings

Nice to have

• Experience setting up and maintaining vector databases
• Experience working with Celery
• Experience defining and using Protobuf messages
• Experience writing production code in Java/Kotlin
• Experience building solutions on cloud infrastructure, particularly AWS
• Experience working with highly sensitive data in a healthcare environment

About the company

Lyra Health is a provider of evidence-based mental health care, serving more than 20 million people globally in partnership with employers. Its Lyra Empower platform combines care and AI-powered technology.