Anyscale
Engineering Manager, Ray Data
San Francisco. Posted 17 days ago
The role
You will manage the open source Ray Data team, which is a Python-native data processing engine for AI workloads. You will lead engineers, set technical direction and roadmaps, and work with the open source community.
What you will do
- Set the technical direction and roadmap for open source Ray Data
- Drive execution of the team's key projects from design review through release
- Hire, coach, and grow a team of distributed systems and data infrastructure engineers
- Run the team day to day including planning, prioritization, project tracking, on-call, and release quality
- Stay technically hands-on through design and code review, performance investigations, and escalations
- Represent Ray Data in the open source community and work with external contributors
- Partner with Ray Core, Ray Train, Ray Serve, and Anyscale platform teams
- Work with product management, field engineering, and customers to understand workloads
- Build and maintain a team culture of collaboration, ownership, and high engineering standards
- Communicate the team's work through talks, tutorials, blog posts, and at Ray Summit
Required qualifications
- 7+ years of software engineering experience
- 2+ years directly managing engineers
- A record of building high-performing distributed teams and helping them scale quickly
- Experience with building and managing teams across geographic locations
- Ability to keep a high hiring bar, motivate the team, coach and mentor engineers, and handle performance management issues
- Deep technical knowledge of distributed systems and data-intensive systems
- Hands-on depth in Python and performance-sensitive systems code
- A great track record of execution with a sense of urgency and excellent prioritization skills
- Effective written and verbal communication with engineers, customers, and an open source community
Nice to have
- Experience leading or maintaining a widely used open source project
- Hands-on experience with Ray, Spark, Flink, Beam or similar engines
- Experience with Apache Arrow, columnar formats, or table formats such as Iceberg and Delta Lake
- Experience with GPU workloads, LLM or multimodal batch inference, or data loading for large-scale model training
- Experience operating data or ML infrastructure in production
Benefits
- Competitive salary and equity
- Health/dental/vision coverage (many plans up to 99% employer-covered)
- Flexible time off
- Paid parental leave
- Mental health support
About the company
Anyscale is commercializing Ray, a popular open-source project for scalable machine learning. The company is backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.