Senior Staff Software Engineer

The role

You will drive the architecture and technical direction of services that bring AI research and models into production. You will design secure, scalable AWS Serverless solutions and partner with AI researchers and product managers.

What you will do

• Drive technical direction and architecture for ML/LLM systems across multiple AI platform teams.
• Design secure, scalable, fault-tolerant AI/ML solutions using AWS Serverless technology.
• Evaluate and prototype new AI technologies to guide build-vs-buy decisions.
• Serve as the go-to contact for architecture problems and questions across the Platform AI org.
• Mentor Staff Software Engineers and Applied Scientists through code review and design partnership.
• Collaborate with Applied Scientists and Product teams to productize AI capabilities.
• Design, build, and scale search and retrieval systems including OpenSearch and semantic/vector search.
• Lead through ambiguity to help teams navigate undefined problems to successful delivery.

Required qualifications

• 10-15+ years of professional experience developing and owning high-scale, secure cloud applications.
• Demonstrated track record operating at Staff level across multiple teams.
• Strong proficiency in Python and its data science libraries/frameworks (pandas, NumPy, scikit-learn).
• Code that adheres to SOLID principles.
• Experience with infrastructure-as-code practices in AWS (CDK, Terraform, or CloudFormation) or similar.
• Hands-on experience with LLMs, including prompt engineering, fine-tuning, model evaluation, and RAG-based functionality.
• Hands-on experience with search technologies, including OpenSearch/Elasticsearch, semantic search, and vector embeddings.
• Experience with the full AI-based solution lifecycle, from research prototype to production system.
• Demonstrated mentorship experience, including mentoring senior/staff-level engineers.

Nice to have

• Bachelor's, Master's, or PhD in Computer Science, Machine Learning, Mathematics, or a related field.

Benefits

• Flexible work environment
• Global days of service
• Comprehensive health benefits
• Meeting free days
• Generous time off policy
• Wellness programs

Before you apply

• Visa sponsorship may be available for select positions based on business needs and specific role requirements.

About the company

Diligent is the AI leader in governance, risk and compliance (GRC) SaaS solutions. The company helps more than 1 million users and 700,000 board members clarify risk and elevate governance.