MegaScale-Data: Scaling DataLoader for Multisource Large Foundation Model Training
| Title: | MegaScale-Data: Scaling DataLoader for Multisource Large Foundation Model Training |
|---|---|
| Authors: | Zhao, Juntao; Lu, Qi; Jia, Wei; Wan, Borui; Zuo, Lei; Feng, Junda; Jiang, Jianyu; Chen, Yangrui; Cao, Shuaishuai; He, Jialing; Jiang, Kaihua; Hu, Yuanzhe; Nong, Shibiao; Peng, Yanghua; Lin, Haibin; Wu, Chuan |
| Source: | Proceedings of the 21st European Conference on Computer Systems. :1-18 |
| Availability: | http://dl.acm.org/doi/10.1145/3767295.3803568 |
| Database: | ACM Full-Text Collection |