Solstice

Member of Technical Staff (ML)

New York City. Posted 25 days ago

The role

You will improve models, representations, and data that power AI agents for creating, refining, and reviewing pharmaceutical marketing content. You will investigate agent failures, implement improvements, and test quality, reliability, latency, and cost before production.

What you will do

  • Improve model behavior inside agents
  • Diagnose failures in evidence selection, tool choice and arguments, and revisions based on feedback
  • Make retrieval and grounding more accurate
  • Develop and compare retrieval, reranking, and claim-to-evidence matching approaches
  • Build curated datasets from successful and failed runs, corrections, and targeted examples
  • Implement and test substantive improvements using model choices, representations, and context strategies
  • Measure complete-task outcomes and evaluate intermediate tool behavior
  • Ship improvements into production Python services and agent workflows

Required qualifications

  • Strong ML fundamentals and hands-on implementation skills
  • Strong Python and hands-on experience building or improving LLM systems, retrieval systems, or agents
  • Evidence of taking a data or model improvement into production
  • Sound experimental judgment
  • Depth in at least one relevant area such as retrieval and ranking, representation learning, model adaptation, or learning from human feedback
  • Judgment about the source of a failure
  • Practical software engineering skills for reproducible experiments, tested components, production integration, and debugging
  • Clear communication and personal ownership

Nice to have

  • Experience with scientific documents, human review feedback, or regulated enterprise products
  • Healthcare or pharma experience

Benefits

  • Health, dental, and vision insurance
  • Ground-floor equity opportunity
  • Visa sponsorship for O-1, H-1B, and TN visas
  • Unlimited PTO
  • 401(k) with a 4% company match
  • In-office lunches five days a week
  • Professional growth stipend
  • Relocation support

About the company

Solstice builds AI software that helps life sciences teams create, refine, and review pharmaceutical marketing content. They have worked with leading life sciences manufacturers and more than 50 pharma brands.

Member of Technical Staff (ML) at Solstice | JobZoey