MLP-Offload: Multi-Level, Multi-Path Offloading for LLM Pre-training to Break the GPU Memory Wall
| Title: | MLP-Offload: Multi-Level, Multi-Path Offloading for LLM Pre-training to Break the GPU Memory Wall |
|---|---|
| Authors: | Maurya, Avinash Kumar; Rafique, M. Mustafa; Cappello, Franck; Nicolae, Bogdan |
| Source: | Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. :1381-1394 |
| Availability: | http://dl.acm.org/doi/10.1145/3712285.3759864 |
| Database: | ACM Full-Text Collection |