Scaling Ray to 10K NPUs: Huawei's Hyperscale Journey

Ray Summit 2024October 2, 2024San Francisco, CASpeaker, with Chong Yin Tan and Xiaoshuang Liu

Play video

How our team runs Ray on clusters of 10,000 Huawei Ascend NPUs, and the scalability, stability and performance work that went upstream into Ray along the way.

• Session page
• Ray accelerator support