Research Engineer, Robotics Data

The role

You will develop datasets and evaluations to make robotics data useful for training and evaluating embodied AI systems. This involves translating research needs into data specifications, building validation methods, and running experiments to improve model performance.

What you will do

• Research the data needs of robot learning and physical AI systems
• Turn research needs into concrete dataset and evaluation specifications
• Define data schemas, annotations, ground truth, and quality standards
• Design collection and review protocols for external data providers
• Build tools and validation workflows to audit datasets
• Run experiments and analyze model behavior
• Work with research and engineering teams, data vendors, and buyers

Required qualifications

• Experience in robotics, robot learning, embodied AI, or closely related multimodal research
• Proficiency in Python
• Experience building data processing, analysis, or evaluation tools
• Experience turning research questions into dataset specifications, experiments, and measurable quality criteria
• Strong understanding of what makes robotics data useful for training or evaluation
• Attention to detail to spot errors, coverage gaps, and failure modes in complex data
• Experience building research tools or pipelines without a fully prescribed roadmap

Nice to have

• Worked with robot trajectories, demonstrations, video, sensor data, simulation, or other multimodal robotics datasets
• Experience with imitation learning, reinforcement learning, or vision-language-action models
• Worked in unstructured problem spaces and take ownership from early research through production deployment
• Early-stage startup experience
• Strong communication skills for collaboration across teams and time zones

Benefits

• Competitive compensation
• 100% covered top-of-the-line medical, dental, and vision (US and Singapore employees)
• Lunch and dinner for in-office employees
• Company-wide holiday break (Christmas Eve to New Year’s Day) on top of PTO and paid holidays
• 401k with a 4% match
• Equinox membership and commuter benefits (US employees)
• Health/wellness stipend (Singapore employees)
• Unlimited access to tokens for ChatGPT, Claude Code, Cursor, etc.
• Annual travel budget to visit either office

Before you apply

• Remote candidates must work hours that 70-80% overlap with either San Francisco or Singapore time zones
• Support for relocation and visas is provided for strong full-time candidates to the US or Singapore
• The process includes 2 technical interviews and a 2-3 day work trial

About the company

HUD's mission is to build reliable, fair and open infrastructure for AI data. Their marketplace and platform are used by startups, Fortune 500 companies and frontier labs.