Healthcare & Medical Expert

The role

You will design and validate realistic healthcare and medical tasks to challenge advanced AI agents. This involves developing tasks for medical record interpretation, data analysis, and clinical workflow assessment.

What you will do

• Design realistic medical and healthcare tasks based on clinical, research, epidemiological, or healthcare administration workflows.
• Develop tasks involving medical record interpretation, clinical documentation review, and healthcare data analysis.
• Analyze clinical research findings, medical literature, and evidence-based guidelines.
• Prepare and validate calculations involving epidemiological metrics, clinical statistics, or healthcare outcomes.
• Develop tasks involving diagnostic documentation, medical coding, imaging reports, or clinical research protocols.
• Identify inconsistencies, missing information, unsupported conclusions, and errors in medical documentation.
• Create reference solutions supported by scientific evidence, documented assumptions, and reliable sources.
• Review AI-generated medical analyses and reports for accuracy, completeness, and appropriate interpretation.
• Collaborate with technical contributors to define reproducible tasks and objective evaluation criteria.
• Work with appropriately de-identified or synthetic data, following relevant privacy and confidentiality requirements.

Required qualifications

• A medical degree, a bachelor's degree or higher in a relevant health sciences discipline, or equivalent specialized professional qualifications.
• Substantial professional experience in at least one of the following areas: clinical medicine, radiology, epidemiology, clinical research, public health, or healthcare informatics.
• Strong understanding of medical terminology, healthcare documentation, and evidence-based decision-making within your specialty.
• Ability to interpret clinical records, research documentation, medical datasets, or diagnostic reports.
• Experience analyzing healthcare information and identifying discrepancies or unsupported conclusions.
• Familiarity with relevant clinical, scientific, or healthcare quality standards.
• Strong analytical reasoning and attention to detail.
• Ability to communicate complex medical or scientific concepts clearly.
• Strong written English communication skills.

Nice to have

• An MD, Master's, PhD, or relevant professional certification in a medical or healthcare discipline.
• Clinical specialization, professional medical licensure, or board certification.
• Experience with clinical trials, systematic reviews, or healthcare research.
• Familiarity with medical imaging, DICOM, electronic health records, or healthcare interoperability standards.
• Experience with medical statistics, Python, R, or healthcare data analysis tools.
• Previous experience reviewing AI-generated medical content, clinical AI applications, or medical evaluation benchmarks.

About the company

Anyone AI creates high-quality training and evaluation data for frontier AI models.