Sr. Software Engineer, Pretraining Data

The role

Senior Software Engineers will build and own data systems for frontier model initial training. You will work on large-scale crawling, data platform, and pipeline infrastructure to turn raw dumps into training datasets.

What you will do

• Design, build, and scale distributed infrastructure for transforming raw data into training-ready datasets.
• Own high-throughput data pipelines, orchestration systems, and tooling.
• Build and deploy models and algorithms to classify, rank, deduplicate, filter, and clean training data.
• Design and execute experiments across data mixtures, sampling strategies, and quality thresholds.
• Build and optimize large-scale web crawling infrastructure.
• Improve crawl coverage, efficiency, and reliability.
• Lead complex engineering initiatives across multiple teams.
• Influence technical direction and drive architectural decisions.
• Mentor engineers.

Required qualifications

• 5+ years of professional software engineering experience building distributed systems and/or large-scale data infrastructure
• Must be able to work in person at the Palo Alto office

Nice to have

• Strong infrastructure or data platform background, ideally with a spike of outlier depth
• High-slope engineer who has moved unusually fast (e.g., staff-level ownership within a few years) or brings relevant domain experience
• Able to architect and ship end-to-end with high ownership, debug complex systems independently, and work alongside AI agents
• Strong intuitions about large-scale distributed systems, including running them reliably at frontier scale
• Track record of leading technical projects across teams and mentoring other engineers
• Excited to learn how pre-training data shapes model quality, and want the ownership and visibility that comes with building systems that feed frontier training runs

Benefits

• Equity
• Comprehensive medical, vision, and dental coverage
• Access to a 401(k) retirement plan
• Short & long-term disability insurance
• Life insurance
• Various other discounts and perks

About the company

SpaceXSI is building Super Intelligence to help humanity understand the universe. They are building the full Super Intelligence stack, from Colossus supercomputers to Grok models and applications.