Kineticsystems
Member of Clinical Staff
San Francisco. Posted 10 days ago
The role
You will drive the research agenda to advance AI model capabilities on real-world healthcare tasks. You will build reinforcement learning environments, datasets, and benchmarks, and publish academic papers.
What you will do
- Design and build evaluations that reflect real clinical work
- Find where frontier models fall short on real clinical workflows
- Turn gaps into environments, evals, and benchmarks
- Write rubrics and guidelines that capture expert clinical judgment
- Build gold-standard datasets
- Pilot new tasks and set the quality bar for the clinician network
- Lead calibration with clinician raters and adjudicate hard cases
- Work with the ML team to turn training and evaluation needs into clinical data
- Write and publish papers in academic conferences
Required qualifications
- Must have one of the following medical degrees: MD, DO, MBBS, NP, or PA
- 2+ years of experience working in a real clinical environment
- Serious work in the human data space, at a frontier AI lab or a human data company
- Built RL environments, evals, or graders
- Understand how data quality shapes model training, including preference data, rubric design, and rater agreement
- Understand healthcare data (e.g., EHR data structures, interoperability, HIPAA considerations)
- Comfortable working with code: read and modify environment and grader code, write scripts to build and analyze datasets, and dig into model outputs
Nice to have
- JavaScript/TypeScript, CI/CD, or AWS experience
- Experience shipping production software or digital health products
- Experience with clinical workflow analysis or quality improvement initiatives
- Work in Git alongside engineers (branches, PRs, code review)
Benefits
- Founding-level impact and ownership
- An opportunity to advance AI research in one of its most meaningful application areas
- Competitive compensation and meaningful equity
- Unlimited PTO
- Comprehensive health, dental, and vision coverage
- 401(k)
- Free lunch + dinner
About the company
Kinetic Systems is a healthcare AI research lab. They partner with frontier labs and healthcare organizations to help make AI models safer and more reliable.