Coderabbit
Senior Applied AI Engineer
San Francisco, Remote. Posted 14 months ago
The role
You will design, build, and deploy advanced generative AI systems for code review and developer productivity tools. You will integrate techniques like RAG, RLHF, and multi-step agentic reasoning into product workflows.
What you will do
- Design and optimize LLM-based systems for high-quality, context-rich code reviews
- Build and refine agentic workflows that reason across multiple steps and contexts
- Develop and maintain knowledge base and retrieval pipelines
- Deploy generative AI models and pipelines into production and monitor performance
- Collaborate across teams to ensure AI outputs align with user needs and product goals
- Analyze human-in-the-loop feedback and usage data to improve system performance
- Apply RLHF, ranking, and reward modeling techniques to improve response quality
- Stay current with the latest generative AI developments and apply them to new use cases
Required qualifications
- Degree in Computer Science, Engineering, Artificial Intelligence, or related field, or equivalent practical experience
- 5+ years applying ML or LLM-based systems in real-world production environments
- At least 2 years of industry experience focused on generative AI
- Strong programming skills in TypeScript and Python
- Experience with tooling such as LangChain, LlamaIndex, OpenAI APIs, or vector databases like Pinecone or Lancedb
- Strong skills in prompt engineering
- Ability to extract insight from telemetry, logs, user signals, and structured feedback
- Comfortable applying research-inspired methods to solve concrete product challenges
- Experience working across product, engineering, and design to deliver production-grade systems
Nice to have
- Experience optimizing RAG systems and tuning retrieval performance using custom embeddings or search strategies
- Hands-on experience with RLHF pipelines, reward modeling, or behavioral policy tuning in LLMs
- Experience integrating LLM systems into developer tooling or collaborative workflows
- Track record of contributions to open-source projects or publications in applied AI/ML
About the company
CodeRabbit is the governance and control layer for agentic software development. The platform provides independent validation grounded in codebase context and team standards.