Kineticsystems

Member of Clinical Staff

San Francisco. Posted 10 days ago

The role

You will drive the research agenda to advance AI model capabilities on real-world healthcare tasks. You will build reinforcement learning environments, datasets, and benchmarks, and publish academic papers.

What you will do

  • Design and build evaluations that reflect real clinical work
  • Find where frontier models fall short on real clinical workflows
  • Turn gaps into environments, evals, and benchmarks
  • Write rubrics and guidelines that capture expert clinical judgment
  • Build gold-standard datasets
  • Pilot new tasks and set the quality bar for the clinician network
  • Lead calibration with clinician raters and adjudicate hard cases
  • Work with the ML team to turn training and evaluation needs into clinical data
  • Write and publish papers in academic conferences

Required qualifications

  • Must have one of the following medical degrees: MD, DO, MBBS, NP, or PA
  • 2+ years of experience working in a real clinical environment
  • Serious work in the human data space, at a frontier AI lab or a human data company
  • Built RL environments, evals, or graders
  • Understand how data quality shapes model training, including preference data, rubric design, and rater agreement
  • Understand healthcare data (e.g., EHR data structures, interoperability, HIPAA considerations)
  • Comfortable working with code: read and modify environment and grader code, write scripts to build and analyze datasets, and dig into model outputs

Nice to have

  • JavaScript/TypeScript, CI/CD, or AWS experience
  • Experience shipping production software or digital health products
  • Experience with clinical workflow analysis or quality improvement initiatives
  • Work in Git alongside engineers (branches, PRs, code review)

Benefits

  • Founding-level impact and ownership
  • An opportunity to advance AI research in one of its most meaningful application areas
  • Competitive compensation and meaningful equity
  • Unlimited PTO
  • Comprehensive health, dental, and vision coverage
  • 401(k)
  • Free lunch + dinner

About the company

Kinetic Systems is a healthcare AI research lab. They partner with frontier labs and healthcare organizations to help make AI models safer and more reliable.