Fal Ai
Software Engineer, Site Reliability
Remote - Global. Posted 8 months ago
The role
You will own and operate Kubernetes infrastructure, including cluster lifecycle, upgrades, and networking. You will build CI/CD pipelines, automate production issue resolution using AI, and manage observability through dashboards and alerting.
What you will do
- Own and operate Kubernetes infrastructure
- Build and maintain CI/CD pipelines and deployment infrastructure
- Leverage AI to automate analysis and resolution of production issues
- Build dashboards, alerting, and anomaly detection
- Define and enforce SLOs and build incident response processes
- Manage and improve networking, load balancing, and service mesh configurations
- Drive reliability improvements through automation, runbooks, and chaos engineering
Required qualifications
- 5+ years experience in managing critical production systems and software development workflows
- Strong production experience setting up and operating Kubernetes at scale, using infrastructure-as-code (Terraform, Ansible)
- Deep knowledge of Linux networking, container networking (CNI plugins, VXLAN, BGP), and DNS
- Experience building CI/CD systems and GitOps workflows (FluxCD, ArgoCD)
- Proficiency in Python and either Go or Bash for tooling and automation
- Strong experience with logging, monitoring and alerting (Prometheus, Grafana, Loki, Thanos, VictoriaMetrics, Datadog)
- Excellent communication and ability to drive technical decisions across teams
- Self-starter who executes quickly, takes ownership, and constantly seeks improvement
Nice to have
- Experience with managing GPU and AI/ML workloads
- Experience with kernel-based monitoring and routing (eBPF, XDP)
- Experience with security tooling (Falco, Coroot, SIEM)
- Experience with bare metal Kubernetes networking (Calico, Cilium, MetalLB)
- Experience with distributed storage systems (Ceph, Longhorn, etc.)
Benefits
- Interesting and challenging work
- A lot of learning and growth opportunities
- Regular team events and offsites
About the company
fal is the generative media ecosystem powering the next generation of AI products. They build infrastructure, tools, and model access for developers and enterprises.