Software Engineer, Ray Data

The role

You will build, optimize, and scale the Ray Datasets library and data processing capabilities. This involves developing open source software to simplify distributed programming and implementing architectural improvements to Ray core.

What you will do

• Develop high quality open source software to simplify distributed programming
• Identify, implement, and evaluate architectural improvements to Ray core and Datasets
• Improve the testing process for Ray to make releases as smooth as possible
• Communicate work through talks, tutorials, and blog posts

Required qualifications

• At least 5 years of relevant work experience
• Solid background in algorithms, data structures, system design
• Experience in building scalable and fault-tolerant distributed systems
• Experience with data processing, database internals including Spark or Dask

Nice to have

• streaming is a plus

About the company

Anyscale is commercializing Ray, an open-source project for scalable machine learning. The company aims to make distributed computing accessible to software developers.