Staff Backend Engineer, AI Platform

The role

You will architect low latency, real-time microservices to process and detect sensitive data at scale. You will build authentication and API services, maintain internal databases, and optimize AI services for real-time ML inferencing.

What you will do

• Building highly available and secure authentication and API services.
• Maintaining and evolving mission-critical internal databases and services.
• Architecting, optimizing and operating high volume auto-scaling, reliable, real-time data infrastructure and services.
• Optimizing AI services to scale models for low latency, real-time ML inferencing, and agentic AI processing.
• Building Observability at scale for detailed insights into customer usage and performance.
• Writing and maintaining documentation about internal and public services.

Required qualifications

• Expertise in one or more systems/high-level programming languages (e.g. Go, Java, Python, C++)
• Experience running scalable (thousands of RPS) and reliable (four 9’s) systems.
• Experience with developing complex distributed systems scaling to substantial data volumes or millions of users with production quality deployment, monitoring, and reliability.
• Experience with large-scale distributed storage and database systems (SQL or NoSQL, e.g. Postgres, Cassandra)
• Ability to decompose complex business problems and lead a team in solving them.
• Experience with building and maintaining large scale and/or real-time complex data processing pipelines using Kafka, Flink, Snowflake, Databricks, etc.
• 8+ years of experience with proven technical leadership and prowess in scalable, distributed architectures

Nice to have

• Experience with real-time ML inferencing or building Agentic AI systems at very high scale, including building eval pipelines.

About the company

Nightfall is the AI-native, unified data loss prevention and insider risk management platform that protects sensitive data across SaaS apps, GenAI tools, email, endpoint devices, and more. It is backed by leading VC firms including Bain Capital Ventures, Venrock, WestBridge Capital, and Pear VC.