Senior Infrastructure Engineer, AI/ML Systems

The role

You will build the deployment path that takes models and AI services from prototype to production and maintain them. You will work with data scientists, applied AI engineers, and product partners to turn AI ideas into reliable product capabilities.

What you will do

• Build and operate deployment pipelines for AI services
• Deploy and operate model serving, batch scoring, and orchestration pipelines
• Partner with data scientists and applied AI engineers to take prototypes into production
• Own production reliability for AI services including monitoring, alerting, debugging, performance, and cost
• Turn repeated patterns into reusable templates

Required qualifications

• Six or more years in infrastructure, DevOps, platform, or ML engineering, with ownership of systems running in production
• Deep hands-on experience across a wide range of AWS services, including compute, networking, storage, deployment, and monitoring
• Infrastructure-as-code experience (Terraform, CDK, or CloudFormation)
• Experience with containers and modern deployment patterns
• Docker required
• Experience with orchestration and workflow tooling (Airflow, Dagster, Argo, Step Functions, or similar)
• Comfort working through ambiguity and collaborating directly with data scientists and researchers

Nice to have

• Kubernetes or ECS/EKS
• Experience with ML platform components and data pipeline orchestration at scale
• Experience running LLM-based or retrieval-based systems in production
• Experience operating specialized data stores, including graph databases
• Experience building internal tooling, templates, or reference implementations that other engineers adopted

Benefits

• Competitive compensation
• Ownership program
• Flexible work culture
• Generous time off, including local holidays and annual Dim the Lights period
• Comprehensive wellness programs and mental health support
• Learning and development resources, including professional development tools and tuition reimbursement
• The technology and tools you need to do your best work
• Motivosity employee recognition program

Before you apply

• All employees must pass a background check
• Identity verification measures implemented
• Candidates may be asked to verify legal name, current physical location, and provide a valid contact number and residential address

About the company

Instructure aims to amplify the power of people by creating intuitive products that simplify learning and personal development. They create products that turn research into capabilities used by educators and students.