Staff Software Engineer, Frontier Security Team

The role

You will lead the design and development of the Agentic Harness and agent evaluation platform. This involves working across product, infrastructure, applied AI, security, and modeling teams to move capabilities from prototype to customer value.

What you will do

• Architect and build the Agentic Harness for complex AI workflows.
• Design stable interfaces for tool execution, state management, and human review.
• Own agent quality by building evaluation harnesses, datasets, and experiment pipelines.
• Convert ambiguous reports into measurable failure modes and reproducible tests.
• Analyze production agent trajectories to identify failures in reasoning and tool use.
• Close the loop between production incidents and regression prevention.
• Develop measurements for task completion, correctness, safety, and cost.
• Build simulation and replay infrastructure for tests and large-scale experiments.
• Improve agent efficiency through model routing and token optimization.
• Productionize new model capabilities as secure, multi-tenant services.

Required qualifications

• 9+ years of software engineering experience, including technical leadership of complex production systems.
• Direct experience shipping and operating LLM applications, AI agents, or model-backed workflows in production.
• Strong background in distributed systems, service architecture, high-throughput APIs, concurrency, and failure handling.
• Experience building an agent runtime, workflow engine, developer platform, evaluation system, or similar infrastructure.
• Demonstrated ability to evaluate nondeterministic systems without relying on a single aggregate score.
• Fluency in Python.
• Strong proficiency in at least one systems or application language such as Java, Go, Rust, or TypeScript.
• Hands-on knowledge of tool calling, structured generation, retrieval, context engineering, prompt management, and model APIs.
• Experience with production observability, including structured traces, replay, metrics, logs, and incident diagnosis.
• Ability to balance agent quality with latency, reliability, security, and inference cost.
• Track record of setting technical direction and delivering results across organizational boundaries.
• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.

Nice to have

• Building evaluation or observability infrastructure for agentic coding, data engineering, or analytics systems.
• Designing human-evaluation programs, scoring rubrics, annotation workflows, or grader-calibration methods.
• Working with multi-agent orchestration, long-running agents, asynchronous workflows, or durable execution.
• Developing synthetic tasks, simulations, adversarial tests, red-team exercises, or safety guardrails.
• Building retrieval systems that use vector search, hybrid search, semantic indexing, ranking, or caching.
• Operating multi-tenant systems that process sensitive enterprise data.
• Working with model training, fine-tuning, reinforcement learning, or feedback-driven optimization.
• Evaluating and onboarding frontier models based on measured product outcomes.
• Experience with databases, SQL engines, data platforms, Kubernetes, or cloud-native infrastructure.

About the company

Snowflake is powering the era of the agentic enterprise. The company is growing fast and scaling its team to enable and accelerate growth.