Protege
Technical Project Lead, Data Privacy
New York City, NY. Posted 17 days ago
The role
You will lead data privacy projects from initial assessment to certified delivery. This involves designing experiments, running validations, and working with independent expert determiners to protect patient privacy in AI training data.
What you will do
- Lead data privacy projects from first look to certified delivery
- Design and run experiments to decide dataset layers
- Run validation by setting pass bars and testing on held-out samples
- Turn misses into lasting fixes with regression tests
- Work directly with independent expert determiners
- Direct human reviewers and adjudicate disagreements
- Evaluate new tools and models against benchmarks
- Write down learnings to improve future engagements
Required qualifications
- Minimum 2 years in data science, applied statistics, ML engineering, or quantitative research, working with real, messy data
- Solid statistics: sampling, confidence intervals, measurement design and inter-rater agreement
- Strong background, and experience using language models or AI coding tools to move fast
- Healthy skepticism
- Clear writing for technical and non-technical readers
- Authorization to work in the U.S. as a W2 employee
Nice to have
- HIPAA de-identification experience (Safe Harbor or expert determination), or other privacy or healthcare data work
- NER, OCR, clinical NLP or document processing
- Working with auditors, regulators or external reviewers
- Running annotation or labeling projects
About the company
Protege is building a platform to facilitate the secure, efficient, and privacy-centric exchange of AI training data. The company is a lean, fast-moving team of builders focused on solving AI's data problem.