Superdial
Staff Software Engineer, Applied AI
Burlingame, CA. Posted 5 days ago
The role
This person will build and scale backend systems that power LLM applications in healthcare. They will design APIs, pipelines, and infrastructure to make LLMs reliable, secure, and cost-efficient.
What you will do
- Architect and implement scalable, low-latency APIs and services for LLMs
- Build ingestion, preprocessing, and retrieval-augmented generation (RAG) pipelines
- Design systems for model monitoring, evaluation, cost tracking, and guardrails
- Engineer solutions for caching, batching, load balancing, and scaling LLM workloads
- Implement HIPAA-ready infrastructure, data governance, and auditability
- Partner with product, ML engineers, and healthcare experts
- Drive end-to-end delivery of LLM backend projects
- Establish engineering best practices and mentor peers
Required qualifications
- 5+ years of backend or full-stack software engineering experience
- 3+ years working on ML/LLM-enabled applications
- Strong coding skills in Python
- Experience with LLM integration frameworks (Hugging Face, LangChain, LlamaIndex, OpenAI APIs, Anthropic, etc.)
- Deep knowledge of distributed systems, service-oriented architecture, and building APIs at scale
- Cloud-native expertise: AWS/GCP/Azure, Kubernetes, Docker, Terraform, etc.
- Familiarity with MLOps/LLMOps practices: CI/CD for models, evaluation harnesses, monitoring, and reproducibility
- Excellent system design skills
Nice to have
- Experience applying LLMs in healthcare or other regulated industries (FHIR, HL7, HIPAA)
- Hands-on experience with RAG pipelines, vector databases, and structured-output orchestration
- Background in enterprise SaaS or mission-critical platforms where uptime, latency, and scale matter
- Knowledge of responsible AI, safety, and privacy-preserving ML techniques
Benefits
- Competitive salary
- Equity options
- Health coverage
- Dental coverage
- Vision coverage
About the company
SuperDial is transforming AI in healthcare by building scalable, AI-powered solutions that optimize revenue cycle management.