Machine Learning Operations (MLOps) Engineer

The role

You will build systems to move models from notebooks to production. You will own the path from training runs to deployed capabilities, including infrastructure, release processes, evaluation harnesses, and telemetry.

What you will do

• Own model training, fine-tuning, and batch inference infrastructure across AWS and on-premises GPU hardware.
• Stand up and tune LLM inference serving.
• Build for DDIL with local inference and configurable fallback.
• Build CI/CD for models and pipelines.
• Own infrastructure as code, containerization, and GitOps deployment.
• Build and own the evaluation harness.
• Instrument production for drift, latency, cost, retrieval quality, and failure modes.
• Own ingestion, versioning, and lineage for logistics and doctrinal data.
• Build and operate embedding and feature pipelines.
• Build human-in-the-loop infrastructure.

Required qualifications

• 5+ years in MLOps, ML platform, or infrastructure engineering
• Strong Python skills
• Deep Kubernetes and containerization experience
• Infrastructure as code
• Production experience with AWS ML/Azure infrastructure (SageMaker, EKS, or equivalent)
• Hands-on GPU infrastructure experience
• Hands-on experience deploying and operating production software in IL5 or IL6 environments

Nice to have

• Clearance
• LLM serving and inference optimization (vLLM, TensorRT-LLM, quantization, prefix caching)
• Retrieval-grounded systems in production: hybrid retrieval, re-ranking, index freshness, and citation quality
• Edge, on-premises, or disconnected deployment
• Experience supporting ATO, continuous authorization, or production operations in classified environments
• Defense, intelligence, or another accredited or regulated environment
• Palantir Foundry, PostgreSQL/pgvector, NATS/JetStream, or ArgoCD
• A degree in CS, engineering, or a related technical field, or the equivalent built the hard way

Benefits

• generous equity grant
• full healthcare coverage
• 401k
• unlimited PTO

Before you apply

• This position may require the ability to obtain and maintain a U.S. government security clearance.
• The successful candidate must be able to work in a classified environment when necessary.
• U.S. citizenship is a requirement for all positions at Gallatin.
• Proof of citizenship will be required prior to employment if selected.

About the company

Gallatin is rebuilding logistics infrastructure for the national security missions of the United States and allied partners. They build AI systems that determine how logistics decisions are made.