Fal Ai
Software Engineer, Distributed Systems
Remote - Global. Posted 8 months ago
The role
You will take ownership of Rust/Python systems powering an AI inference and large-scale GPU computing platform. You will design for 100x growth in workloads and GPU capacity with reliable, low-latency execution.
What you will do
- Take ownership of Rust/Python systems powering AI inference and large-scale GPU computing platform
- Design for 100x growth in workloads and GPU capacity
- Use AI to accelerate development and automate operations, alerting, and recovery
- Specialize in areas such as request routing, app deployment, worker orchestration, GPU fleet management, global file storage, global IP backbone, or workload execution
Required qualifications
- 3+ years building and operating large-scale production systems
- Strong Rust and/or Python skills
- Strong systems fundamentals in distributed coordination, scheduling, fault tolerance, Linux, networking, storage, or capacity management
- Experience building and using observability to drive performance and reliability decisions
- Clear communication, sound technical judgment, and the initiative to move quickly, drive decisions across teams, and own systems from design through production
Nice to have
- Multi-tenant compute platforms, AI inference or training infrastructure, GPU workload scheduling
- High-performance systems programming: async runtimes, zero-copy, memory-safe concurrency
- Linux systems engineering and fleet automation: configuration management, kernel and driver debugging, safe upgrades, and automated recovery
- Distributed filesystems like JuiceFS and Lustre
- Experience with Nvidia/AMD GPU infrastructure; DCGM, NVLink, RDMA, InfiniBand/RoCEv2
- Global networking and routing: BGP, ECMP, tunnels, eBPF, Geneve
Benefits
- Interesting and challenging work
- A lot of learning and growth opportunities
- Regular team events and offsites
About the company
fal is the generative media ecosystem powering the next generation of AI products. They build infrastructure, tools, and model access for developers and enterprises.