NASPipe: high performance and reproducible pipeline parallel supernet training via causal synchronous parallelism
| Title: | NASPipe: high performance and reproducible pipeline parallel supernet training via causal synchronous parallelism |
|---|---|
| Authors: | Zhao, Shixiong; Li, Fanxin; Chen, Xusheng; Shen, Tianxiang; Chen, Li; Wang, Sen; Zhang, Nicholas; Li, Cheng; Cui, Heming |
| Source: | Proceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems. :374-387 |
| Availability: | http://dl.acm.org/doi/10.1145/3503222.3507735 |
| Database: | ACM Full-Text Collection |