Senior Software Engineer, Cloud Infrastructure

The role

You will lead the buildout of the AWS foundation and the LLM platform. You will design, implement, and operate scalable, reliable, and secure services.

What you will do

• Design, provision, and maintain AWS infrastructure using IaC tools such as AWS CDK or Terraform.
• Build CI/CD and testing for apps, infra, and ML pipelines using GitHub Actions, CodeBuild, and CodePipeline.
• Operate secure networking with VPCs, PrivateLink, and VPC endpoints.
• Manage IAM, KMS, Secrets Manager, and audit logging.
• Stand up and operate model endpoints using AWS Bedrock and/or SageMaker.
• Build and maintain application services that call LLMs through clean APIs.
• Implement prompt and tool execution flows with LangChain or similar.
• Design chunking and embedding pipelines for documents, time series, and multimedia.
• Operate vector search using OpenSearch Serverless, Aurora PostgreSQL with pgvector, or Pinecone.
• Create offline and online eval harnesses for prompts, retrievers, and chains.

Required qualifications

• Shipped or operated LLM-powered applications in production.
• Familiar with RAG design, prompt versioning, and chain orchestration using LangChain or similar.
• Strong with core AWS services such as VPC, IAM, KMS, CloudWatch, S3, ECS/EKS, Lambda, Step Functions, Bedrock, and SageMaker.
• Comfortable building ingestion and transformation pipelines in Python.
• Familiar with Glue, Athena, and event-driven patterns using EventBridge and SQS.
• Applies least privilege, secrets management, network isolation, and compliance practices.
• Uses quantitative evals, A/B testing, and live metrics to guide improvements.

Nice to have

• 4+ years working with serverless or container platforms on AWS.
• Experience with vector databases, OpenSearch, or pgvector at scale.
• Hands-on with Bedrock Guardrails, Knowledge Bases, or custom policy engines.
• Familiarity with GPU workloads, Triton Inference Server, or TensorRT-LLM.
• Experience with big data tools for large-scale processing and search.
• Background in aviation data or other safety-critical domains.
• DevOps or DevSecOps experience automating CI/CD for ML and app services.
• Focus areas in LLM/ML Infra and IoT infra are strong bonus points.
• Experience with IoT AWS services is a plus.

Benefits

• 100% of employee medical premiums covered; 25% for dependents
• 3 weeks PTO
• 13+ paid company holidays
• 401(k) offered

Before you apply

• Can only hire U.S. Persons (U.S. citizens, Green Card holders, lawful permanent residents, or individuals granted asylum or refugee status).
• Unable to provide visa sponsorship or support visa transfers.
• All work must be performed in the United States.

About the company

Beacon AI is a fast-moving team of aviators, engineers, and operators building an AI platform to make flying safer, more efficient, and more capable. They operate without silos or heavy processes using small, focused teams.