Sevenai

Senior AI Engineer

Boston, MA, Remote. Posted 6 months ago

The role

You will build LLM-powered systems including retrieval workflows, context management, agent prompts, and structured output pipelines. You will compose, optimize, and scale AI systems to solve complex enterprise problems.

What you will do

  • Architect and build LLM-powered systems, including retrieval workflows, context management, agent prompts, and structured output pipelines.
  • Orchestrate AI workflows using LangChain, LlamaIndex, or similar frameworks, and integrate them with product APIs and backend services.
  • Own prompt engineering and iteration, refining prompts, templates, and context strategies to meet product quality and reliability goals.
  • Track real-world evaluation metrics such as usefulness, factual correctness, latency, and user experience impact.
  • Work closely with product, platform, and backend teams to ensure integrations land cleanly.
  • Build reliable, scalable deployments that hold up on performance, cost efficiency, and observability in production.

Required qualifications

  • 6+ years of software engineering experience, including at least 1 year building AI in production.
  • BS in Computer Science or a related field.
  • Shipped LLM applications in production, not just prototypes, using large models in ways that meaningfully mattered to the product.
  • Strong coding skills in Python (or equivalent), with experience in API design, backend integration, database systems, and cloud deployment.
  • Hands-on experience with RAG, vector databases (Pinecone, Weaviate), and workflow frameworks like LangChain or Dust.
  • Comfortable architecting end-to-end solutions, including context windows, caching strategies, tool calls, and multi-step reasoning.
  • Experience with multi-modal models or multi-agent system design.
  • Familiar with AI safety guardrails, hallucination mitigation, and structured output enforcement.
  • Focused on product outcomes: the AI needs to work safely and reliably for users, not just perform well on paper.

Nice to have

  • Master's degree in Computer Science or a related field.

About the company

7AI is the foundational AI security company. Founded in 2024 by Cybereason co-founders Lior Div and Yonatan Striem-Amit, the platform pairs a federated SIEM with AI agents.

Senior AI Engineer at Sevenai | JobZoey