Research Engineer, Data Infrastructure (Language Modeling)

The role

You will build datasets and systems that power pretraining at Cartesia. You will write performant, scalable infrastructure to acquire, process, and curate massive datasets and partner with research to optimize data mixtures.

What you will do

• Build and operate performant, scalable data processing infrastructure for acquiring, ingesting, and combining massive text datasets.
• Design and operate scalable, high-throughput, and reproducible data pipelines.
• Design and run ablation experiments to understand how data sources, processing choices, and mixture weights affect model quality.
• Partner closely with research and infrastructure teams to co-design data loading, versioning, and experimentation pipelines.
• Establish and enforce rigorous standards for data quality.
• Identify and source novel datasets.
• Manage relationships and budgets with external data vendors and partners.

Required qualifications

• Hands-on experience with ML data infrastructure: training data pipelines, dataset versioning, large-scale data loading, and the interplay between data systems and model training and inference.
• Strong modern engineering execution: clean, well-tested code, fluency with current tools, and a willingness to pick the right tool for the problem.
• Familiarity with building and evaluating datasets for generative models and reasonable working knowledge of how they're trained and inference.

Nice to have

• Experience with large-scale data processing using parallel infrastructure such as Ray, Spark, or Kubernetes.
• Experience with pretraining language models.

Benefits

• Competitive base salary
• Attractive equity package
• Fully covered medical insurance along with dental and vision for you and your family
• 9 weeks paternity leave
• 12 weeks maternity leave
• 401(k)
• Monthly commuter stipend
• Flexible PTO
• Lunch, dinner and plenty of snacks, provided daily
• Your own personal Yoshi

Before you apply

• Visa sponsorship is provided and assessed on a case-by-case basis.
• Cartesia participates in E-Verify and will provide Form I-9 information to confirm employment eligibility after hire.

About the company

Cartesia aims to architect AI that learns from and interacts with the world like humans do. The founding team met as PhDs at the Stanford AI Lab where they invented State Space Models.