The Case for Strong Scaling in Deep Learning: Training Large 3D CNNs With Hybrid Parallelism
| Title: | The Case for Strong Scaling in Deep Learning: Training Large 3D CNNs With Hybrid Parallelism |
|---|---|
| Authors: | Oyama, Y.; Maruyama, N.; Dryden, N.; McCarthy, E.; Harrington, P.; Balewski, J.; Matsuoka, S.; Nugent, P.; Van Essen, B. |
| Source: | IEEE Transactions on Parallel and Distributed Systems IEEE Trans. Parallel Distrib. Syst. Parallel and Distributed Systems, IEEE Transactions on. 32(7):1641-1652 Jul, 2021 |
| Database: | IEEE Xplore Digital Library |