Software Engineer, Ray Data

Highlights

• Build and scale Ray Datasets library powering ML pipelines at Amazon, Alibaba.
• Optimize performance and stability of large-scale distributed data processing.
• Lead future streaming workloads integration and hosted service data operations.

Ideal candidate

Experienced distributed systems engineer who loves simplifying complex infrastructure and building high-quality open source. Passionate about data processing performance and communicating work through talks and tutorials.

Requirements

• At least 5 years of relevant work experience
• Solid background in algorithms, data structures, system design
• Experience in building scalable and fault-tolerant distributed systems
• Experience with data processing, database internals including Spark or Dask (streaming is a plus)