Senior/Staff Software Engineer

The role

You will build and scale the core infrastructure that powers the AI agent platform. You will design robust services and scalable systems with a focus on automation, observability, reliability, and performance.

What you will do

• Manage AI agents to execute tasks quickly and thoughtfully using AI-assisted coding.
• Lead code, system design, and architecture reviews.
• Teach and mentor team members.
• Design, implement, and maintain scalable and secure backend services and platform components.
• Drive infrastructure automation, CI/CD, and monitoring/alerting pipelines.
• Collaborate with product engineering and research teams to deploy, scale, and optimize ML/NLP workloads.
• Lead initiatives to improve system reliability, scalability, and developer experience.
• Contribute to architecture and infrastructure decisions.
• Champion best practices in code quality, testing, and DevOps culture.

Required qualifications

• 5+ years of experience as a software engineer with a focus on backend systems and platform engineering.
• Proficiency in Java and Python.
• Deep experience with all computing environments (GCP, AWS, Onprem, or Azure).
• Strong understanding of containerization and orchestration (Docker, Kubernetes).
• Experience with infrastructure-as-code (Terraform, Pulumi, etc.).
• Experience with observability tools (Prometheus, Grafana, ELK/EFK, etc.).
• Experience working on ML platforms or supporting ML workloads in production.
• Experience designing and operating distributed systems.
• Familiarity with data infrastructure (e.g., Kafka, Spark, Airflow).

About the company

Vectara is seeking a Senior/Staff Platform Software Engineer to work on building and scaling the core infrastructure that powers their AI agent platform.