Generalintelligencecompany

Applied AI Engineer - Agent

New York. Posted 13 months ago

The role

You will own core backend systems and applied LLM work to advance agent reliability and autonomy. You will design agent improvements, build evaluation pipelines, and productionize LLM techniques.

What you will do

  • Design and implement agent improvements end-to-end
  • Build robust evaluation pipelines for the agent
  • Productionize applied LLM techniques
  • Improve core backend systems
  • Partner with product and infra to define success metrics and ship fast, safe iterations
  • Write clean, well-tested code
  • Document design decisions and runbooks

Required qualifications

  • 4+ years backend engineering experience
  • Hands-on LLM experience: prompt engineering, function-calling, retrieval, embeddings, evaluation design
  • Shipped LLM features to production
  • Track record building evaluation harnesses and using them to drive improvements
  • Solid distributed systems fundamentals: concurrency, reliability, performance, data modeling, lifecycle management
  • Pragmatic experimentation: hypothesis to prototype to measured improvement to rollout
  • Excellent debugging and instrumentation skills

Nice to have

  • Experience with agent frameworks, tool orchestration, and memory architectures
  • RAG systems in production (chunking, retrieval quality, freshness strategies)
  • Redis, Postgres/Supabase, queues (e.g., Celery/Arq/SQS), and event-driven designs
  • Observability stacks (Datadog, OpenTelemetry), and cost/latency optimization

Benefits

  • Competitive salary
  • Meaningful equity
  • Comprehensive benefits
  • Flexible work setup

About the company

generalintelligencecompany aims to build autonomous agents that run entire businesses.