Anyscale

Engineering Manager, Ray Data

San Francisco. Posted 17 days ago

The role

You will manage the open source Ray Data team, which is a Python-native data processing engine for AI workloads. You will lead engineers, set technical direction and roadmaps, and work with the open source community.

What you will do

  • Set the technical direction and roadmap for open source Ray Data
  • Drive execution of the team's key projects from design review through release
  • Hire, coach, and grow a team of distributed systems and data infrastructure engineers
  • Run the team day to day including planning, prioritization, project tracking, on-call, and release quality
  • Stay technically hands-on through design and code review, performance investigations, and escalations
  • Represent Ray Data in the open source community and work with external contributors
  • Partner with Ray Core, Ray Train, Ray Serve, and Anyscale platform teams
  • Work with product management, field engineering, and customers to understand workloads
  • Build and maintain a team culture of collaboration, ownership, and high engineering standards
  • Communicate the team's work through talks, tutorials, blog posts, and at Ray Summit

Required qualifications

  • 7+ years of software engineering experience
  • 2+ years directly managing engineers
  • A record of building high-performing distributed teams and helping them scale quickly
  • Experience with building and managing teams across geographic locations
  • Ability to keep a high hiring bar, motivate the team, coach and mentor engineers, and handle performance management issues
  • Deep technical knowledge of distributed systems and data-intensive systems
  • Hands-on depth in Python and performance-sensitive systems code
  • A great track record of execution with a sense of urgency and excellent prioritization skills
  • Effective written and verbal communication with engineers, customers, and an open source community

Nice to have

  • Experience leading or maintaining a widely used open source project
  • Hands-on experience with Ray, Spark, Flink, Beam or similar engines
  • Experience with Apache Arrow, columnar formats, or table formats such as Iceberg and Delta Lake
  • Experience with GPU workloads, LLM or multimodal batch inference, or data loading for large-scale model training
  • Experience operating data or ML infrastructure in production

Benefits

  • Competitive salary and equity
  • Health/dental/vision coverage (many plans up to 99% employer-covered)
  • Flexible time off
  • Paid parental leave
  • Mental health support

About the company

Anyscale is commercializing Ray, a popular open-source project for scalable machine learning. The company is backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

Engineering Manager, Ray Data at Anyscale | JobZoey