Staff / Sr. Staff Engineer, AI Gateway

The role

You will architect, build, and scale core systems for the AI Gateway product and its supporting microservices. This role focuses on building highly scalable backend systems across SaaS and on-prem/hybrid environments.

What you will do

• Architect, build, and scale core AI Gateway solutions, backend services, and high-throughput APIs.
• Integrate AI and agent-based tooling into daily development workflows.
• Audit AI-generated code to ensure architectural soundness and security.
• Build distributed systems for handling data payloads, streaming LLM responses, and proxy routing.
• Partner with global engineering, AI researchers, and product teams.
• Drive technical culture through architectural reviews, code reviews, and mentorship.
• Act as escalation point for systemic development roadblocks.
• Participate in shared on-call rotation and monitor service health.

Required qualifications

• 8-10+ years in software engineering
• 5+ years focused on backend development, cloud-native services, and distributed systems
• Exceptional software engineering skills in Golang or Python
• Demonstrated experience using advanced LLM-based coding agents in real engineering work
• Expertise in microservices architecture, RESTful/gRPC API design, and distributed system trade-offs
• Deep understanding of Layer 4-7 networking: proxy architectures, HTTP/S, TLS interception, DNS, TCP/IP, and load balancing
• Hands-on experience developing for and debugging services on Docker/Kubernetes
• Track record of driving ambiguous problems to working software solutions
• Exceptional verbal and written English
• BS in Computer Science, Software Engineering, or equivalent practical experience

Nice to have

• Familiarity with request/response schemas of major LLM providers (OpenAI, Anthropic, Gemini), streaming formats, agentic protocols such as MCP and A2A, and orchestration frameworks like LangChain or L
• Background in Secure Web Gateways (SWG), Zero Trust Network Access (ZTNA), or Data Loss Prevention (DLP)
• Experience developing and operating scalable services in AWS, GCP, or Azure
• Experience with message brokers and event-driven architectures (e.g., Apache Kafka)
• Strong grasp of embedding observability (OpenTelemetry, Prometheus, Grafana) directly into application code
• MS strongly preferred

About the company

Netskope is a leader in modern security and networking for the cloud and AI era. They secure and accelerate cloud, data, and AI in real time, everywhere.