Staff Software Engineer ML Platform (6244)

The role

This role builds backend services for experiment tracking and model registries on the ML platform. The engineer connects training runs, data, code and configuration to model versions, and helps machine-learning engineers reproduce results.

What you will do

• Build experiment-tracking and model-registry services, integrating tools such as MLflow where appropriate.
• Connect exact dataset, code and configuration versions to training runs, checkpoints and model versions.
• Develop APIs and adapters that connect training jobs, data services and artifact storage.
• Make interrupted or failed workflows recoverable through reliable state handling, retries and useful diagnostics.
• Make checkpoints, model artifacts and evaluation results easy to find and retrieve for further training, evaluation or deployment.
• Work directly with machine-learning engineers to simplify their workflows and reduce manual record keeping.
• Deliver tested services with observability and compatible upgrades across supported cloud and customer-managed environments.

Required qualifications

• Experience building production backend services for machine-learning platforms or data-intensive workflows.
• Strong software engineering skills in Python or a comparable backend language.
• Experience designing APIs, metadata models and persistent state for services used by other engineers.
• Experience handling storage, partial failures, retries and consistency in distributed systems.
• Understanding of training runs, checkpoints and model versioning.
• Ability to work directly with machine-learning users and deliver maintainable software that solves their workflow problems.

Nice to have

• Experience with MLflow, Weights & Biases, model registries or comparable experiment-management tools.
• Experience integrating Kubernetes jobs, object storage or machine-learning workflow systems.
• Experience with reproducibility, data provenance or evaluation records.
• Experience supporting open-source software or on-premises and air-gapped deployments.

Benefits

• Equity for full-time regular employees.
• Bonus for full-time regular employees.
• Benefits package for full-time regular employees.
• Temporary benefits package for temporary employees, applicable after 60 days of employment.

Before you apply

• All offers are contingent on a cleared background and possible reference check.
• Military fellows and part-time employees are not eligible for benefits.

About the company

Shield AI is a venture-backed defense-tech company that builds intelligent systems to protect service members and civilians. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation technologies.