Azure OpenAI & RAG Engineer

The role

This engineer will design and implement an AI inference and Retrieval-Augmented Generation (RAG) pipeline for the Department of State. The role involves provisioning Azure OpenAI Service on Azure Government and building pipelines that ground AI responses in agency playbooks and vulnerability feeds.

What you will do

• Provision and configure Azure OpenAI Service on Azure Government
• Design and implement the RAG pipeline using Azure AI Search
• Build and maintain automated data ingestion pipelines
• Implement ServiceNow ticket context injection
• Design and implement the AI confidence scoring mechanism
• Implement CUI-safe prompt construction
• Configure Azure AI Content Safety filters
• Monitor model performance, token consumption, and response latency
• Support monthly review of AI confidence score distribution and metrics
• Produce AI system documentation

Required qualifications

• 3+ years of experience with Azure OpenAI Service including API integration, prompt engineering, and deployment in enterprise environments
• Demonstrated experience building RAG pipelines using Azure AI Search or equivalent vector search technology
• Experience with Python or JavaScript/TypeScript for AI pipeline development
• Familiarity with LLM prompt engineering techniques including few-shot prompting, chain-of-thought, and system prompt design
• Experience with FedRAMP-authorized cloud environments, specifically Azure Government
• Experience with REST API integrations for data feed ingestion
• Active Top Secret security clearance OR ability to obtain TS within program timeline (interim clearance accepted to start)
• US Citizenship is required

Nice to have

• Active Top Secret clearance
• Experience with LangChain, Semantic Kernel, or Azure AI Foundry
• Experience integrating AI systems with ServiceNow or similar ITSM platforms
• Familiarity with CISA KEV, NVD CVE data structures, and cybersecurity vulnerability terminology
• Experience with Microsoft Copilot Studio or Power Platform AI Builder integrations
• Azure AI certifications (AI-102, DP-100, or equivalent)
• Experience with GCC High M365 environments and their AI service constraints
• Familiarity with NIST AI RMF, OMB M-25-21 AI governance requirements, or federal AI policy

Benefits

• Certification incentive program
• PTO
• Floating federal holiday options
• HMO and High Deductible plans with Health Savings Accounts [HSAs]
• Flex Spending Accounts [FSAs]
• Full Dental Plans
• Vision
• ST/LT Disability
• Life Insurance
• 401k matched

Before you apply

• Active Top Secret security clearance OR ability to obtain TS within program timeline
• US Citizenship is required

About the company

SkyePoint Decisions is an IT service provider for Cybersecurity Architecture and Engineering, Critical Infrastructure and Operations, and Applications Development and Maintenance. The company provides solutions for federal government clients.