Anuvaya
Member Of Technical Staff – Agent Orchestration
New Delhi. Posted 4 months ago
The role
You will own and evolve the stateful agent runtime, including the streaming pipeline, state management, and tool execution layer. You will work on the system that coordinates LLM calls, tool execution, context management, delivery pacing, and conversation persistence.
What you will do
- Own and evolve the stateful agent runtime
- Ensure user visibility, model memory, and persistence stay in sync
- Build and refine the streaming architecture
- Implement and tune delivery pacing
- Design the tool execution layer
- Work on autonomous continuation
- Optimize for latency and reliability
Required qualifications
- Deep systems programming instincts regarding state machines, concurrency, race conditions, and failure modes
- Experience building real-time or streaming systems such as WebSockets, SSE, or similar
- Experience building and maintaining stateful, long-running processes in production
- Comfort with distributed systems including message queues, event-driven architectures, and service coordination
- Strong debugging skills for systems
- Ability to read and reason about concurrent code such as Elixir processes, Go goroutines, or async runtimes
Nice to have
- Experience with Elixir/OTP - GenServers, supervisors, the actor model
- Familiarity with LLM APIs and streaming protocols (SSE, chunked responses)
- Experience building or working on conversational AI systems
- Experience with NATS, Kafka, or other messaging systems
- Having read the whitepaper on Stateful Agent Orchestration
About the company
Anuvaya is a small group of engineers, designers, and product folks building at the intersection of conversational AI and domain expertise. They are backed by Accel, Arkam Ventures, and Weekend Fund.