Senior Software Engineer, Crusoe Managed Data Transfer

The role

You will build the MDT control plane, including the job API, scheduler, and job state. You will work on moving petabyte-scale training data from AWS S3 and other clouds into Crusoe storage.

What you will do

• Design and build the data-transfer API
• Build the scheduler and state machine to manage units of work
• Make petabyte-scale jobs safe to retry and cancel with checksum verification
• Implement secure access to customer buckets with short-lived credentials
• Ship the CLI and work with partner teams on Terraform and Console experiences
• Instrument the service with metrics, logs and alerts
• Write runbooks and participate in on-call rotation
• Agree on interfaces with Storage, Network, IAM and Console teams
• Work with Product and Solutions Architects on early customer onboarding

Required qualifications

• Experience designing and shipping production backend services and APIs, ideally in Go, with gRPC or REST, relational databases and Kubernetes
• 5+ years building cloud infrastructure or platform services, including taking a service from zero to general availability
• Comfort with long-running, failure-prone work: idempotency, retries with backoff, leases, checkpointing and partial failure
• Ability to design public APIs that customers automate against and that can grow without breaking changes
• Working knowledge of authentication, authorization and least privilege
• Experience running services in production, being on call, and building dashboards and alerts
• Ability to work across teams and write design docs
• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent professional experience

Nice to have

• Experience with large-scale data movement, such as S3 multipart uploads, rclone, s5cmd, AWS DataSync or Google Storage Transfer Service
• Hands-on experience with cross-cloud identity: AWS IAM and STS, GCP service-account impersonation, or Azure workload identity
• Experience with storage systems (object storage, NFS, parallel file systems) or high-throughput networking
• Experience with job orchestration systems such as Temporal, Argo, or Kubernetes operators
• Experience building on GPU or AI infrastructure

Benefits

• Competitive compensation and equity packages
• Restricted Stock Units
• Paid time off, paid holidays & leave of absence programs
• Comprehensive health, dental & vision insurance
• Employer contributions to HSA account
• Paid parental leave
• Paid life insurance, short-term and long-term disability
• Professional development & tuition reimbursement
• Mental health & wellness support
• Commuter benefits (parking & transit)
• Cell phone stipend
• 401(k) Retirement plan with company match up to 4% of salary

About the company

Crusoe is a vertically integrated AI infrastructure company that owns and operates each layer of the stack to power AI workloads. They use an energy-first approach to solve the demand for AI compute.