AI Systems Engineer

The role

You will lead the platform and backend architecture for real-time security detection services. This involves building and scaling low-latency serving infrastructure for Small Language Models, Prompt Injection engines, and Content / Intent Classification platforms.

What you will do

• Architect, build, and optimize production serving pipelines for Small Language Models and traditional ML models.
• Own and scale backend microservices delivering real-time threat detection.
• Build consumption-based monitoring, tenant rate-limiting, and runtime guardrail infrastructure.
• Manage and optimize GPU cluster replicas to minimize cold-start times and manage costs.
• Build continuous evaluation, automated retraining pipelines, model CI/CD, and automated regression gates.
• Refactor legacy service boundaries, service-to-service auth flows, and backend database configurations.

Required qualifications

• 5+ years of software engineering experience building distributed backend systems or high-throughput microservices.
• Proven track record in model serving and inference optimization (e.g., TensorRT, vLLM, ONNX Runtime, Triton Inference Server).
• Strong programming experience in Python, Go, or C++.
• Hands-on expertise with Kubernetes, container orchestration, GPU scheduling, and infrastructure auto-scaling.
• Solid understanding of CI/CD pipelines, MLOps/LLMops principles, and cloud infrastructure (AWS/GCP).

Nice to have

• Experience building consumption-based rate limiting or multi-tenant guardrail architectures.
• Familiarity with database refactoring, auth protocols, and backend technical debt remediation.
• Background in cybersecurity, threat detection engines, or DLP/PII filtering platforms.
• Experience benchmarking runtime vs. accuracy trade-offs between local SLMs and cloud LLMs (e.g., Vertex AI).
• Experience with AWS, GCP, Terraform, Kubernetes, and Linux.

About the company

Menlo Security is the leader in Browser Security for human and agentic workforces. The Menlo Browser Security Platform protects organizations from cyberattacks by stopping threats across the web, documents, and email.