Brightstar Ai

Applied AI Engineer Intern - Advancing Agent Quality

Miami. Posted a month ago

The role

The intern will build evaluation environments, automated raters, and diagnostic tooling for proprietary AI systems. They will focus on the AI Twin Board to develop task suites, LLM judges, and failure-mode diagnostics.

What you will do

  • Design, build, and scale realistic agent environments and task suites.
  • Develop agentic LLM judge and benchmark Brightstar agents.
  • Build trajectory-analysis frameworks and diagnostic tooling.
  • Enable agents to generate and iterate on their own verifiers.
  • Harvest multi-turn interaction trajectories into high-quality datasets.
  • Contribute to the AI Twin Board build-out.
  • Contribute frontier AI research perspectives to the Think Tank.
  • Review relevant research papers and conference findings.
  • Help interpret academic and technical developments for business and investment audiences.

Required qualifications

  • Currently enrolled in a Masters or PhD program or serving as a postdoctoral or early-career academic researcher in Artificial Intelligence, Machine Learning, Computer Science, Computational Linguistic
  • 1 years of research, project, or professional experience with LLMs or Agents.
  • 2 year of experience with machine learning and deep learning.
  • Experience in software engineering and cloud-based development.
  • Experience with agent builders, e.g. OpenSDK, OpenAI Agent Builder, etc.
  • Able to communicate complex technical concepts clearly to non-technical executive audiences.

Nice to have

  • In-depth knowledge of machine learning algorithms, including supervised learning and reinforcement learning.
  • Hands-on experience building LLM or agent evaluation systems.
  • Experience with multi-agent orchestration, retrieval-augmented generation, and tool-use / function-calling reliability.
  • Active research or publications in LLMs, reasoning systems, model behavior, AI safety, or the societal impact of advanced AI systems.
  • Strong research discipline, intellectual curiosity, and the ability to separate meaningful signal from AI hype.
  • Affiliated with a (South Florida) university and working under the supervision of a faculty member or professor, or recent graduate.

About the company

Brightstar.AI is an organization with an AI Think Tank that provides systematic forward-looking intelligence on AI value and industry disruption.