Alphasense
Senior Engineering Manager, AI
Remote - United States. Posted 3 months ago
The role
This leader will manage and grow a team of up to 10 senior and staff software engineers. You will own the strategy and architecture of the enterprise AI Gateway to handle high-throughput LLM traffic.
What you will do
- Manage, mentor, and grow a team of up to 10 senior and staff software engineers.
- Foster a high-performance culture of technical excellence and predictable delivery.
- Own the strategy and architecture of the enterprise AI Gateway.
- Ensure high availability, sub-millisecond routing, caching, queueing, and fallback mechanisms.
- Guide the integration, evaluation, and management of 6+ major LLM vendors and 50+ models.
- Partner with product management, AI research teams, and executive engineering leads.
- Define and champion software engineering best practices and architectural standards.
- Define token-based cost-tracking telemetry.
Required qualifications
- Strong track record of managing and growing high-performing teams of senior and staff engineers.
- Background in designing, building, and operating high-throughput, low-latency distributed systems.
- Experience with complex routing, caching, queueing, or rate limiting.
- Ability to engage in high-level architectural discussions and provide technical direction.
- Exceptional communication and partnership skills to align engineering, product, and executive partners.
- Active embrace of AI tools in developer workflows.
Nice to have
- Experience in the applied AI space or working with frameworks and tools such as LangChain, LangGraph, LiteLLM, or OpenRouter.
- Experience with orchestrators and proxies like Temporal, Envoy, or similar enterprise-grade gateway technologies.
- Experience with Python, Java, and highly distributed caching/queueing systems.
Benefits
- Equity
- Generous benefits program
About the company
AlphaSense is the AI platform redefining market intelligence and workflow orchestration. The platform combines domain-specific AI with a vast content universe of over 500 million premium business documents.