Software Engineer - Core Systems

The role

You will build and operate core infrastructure including an ingestion pipeline, a data warehouse, and a distributed inference system. You will work across the backend stack to design services, evolve schemas, and ensure system reliability.

What you will do

• Design, build, and operate infrastructure for end-to-end experiences from data ingestion to model output.
• Design and implement robust data pipelines and warehouses for large-scale multimodal medical imaging data.
• Build CI/CD and deployment automation.
• Ensure systems handling PHI are HIPAA-compliant through encryption, access controls, and audit logging.
• Build model inference pipelines for live and offline traffic.
• Support ML infrastructure alongside the ML team as needs arise.
• Lead technical design and drive quality through design reviews and testing.
• Help set engineering best practices on a lean team.
• Handle reliability, operations, debugging, and capacity planning.

Required qualifications

• 6+ years of experience building data infrastructure, storage systems, or related distributed systems
• 2+ years of experience leading large scale, complex projects or teams as an engineer or tech lead
• Proficiency in a backend language (Go, Python, Java, or similar)
• Experience designing, building, and operating large-scale distributed systems or infrastructure (AWS) in production
• Strong problem-solving skills and the ability to troubleshoot complex distributed systems
• Ability to navigate complex technical tradeoffs between performance, cost, security, and maintainability
• Track record of leading complex, multi-quarter technical initiatives spanning multiple teams or systems

Nice to have

• Experience operating in a startup or startup-like environment
• Proficiency in modern web application technologies for the frontend (e.g., TypeScript, React)
• Experience building and operating HIPAA-compliant systems, or handling PHI and healthcare security requirements
• Experience with large-scale ETL, data lake, or data warehouse systems
• Experience contributing to ML infrastructure or model inference pipelines

About the company

Epsilon Health is transforming medical imaging and diagnostics by bringing frontier AI into clinical practice. The company is backed by Jack Altman, Uncork Capital, Renegade Partners, and AlleyCorp.