Zeppelin: Balancing Variable-length Workloads in Data Parallel Large Model Training
| Title: | Zeppelin: Balancing Variable-length Workloads in Data Parallel Large Model Training |
|---|---|
| Authors: | Chen, Chang; Chen, Tiancheng; Duan, Jiangfei; Zhu, Qianchao; Wang, Zerui; Hu, Qinghao; Sun, Peng; Li, Xiuhong; Yang, Chao; Hoefler, Torsten |
| Source: | Proceedings of the 21st European Conference on Computer Systems. :1879-1893 |
| Availability: | http://dl.acm.org/doi/10.1145/3767295.3769369 |
| Database: | ACM Full-Text Collection |