ProPD: Dynamic Token Tree Pruning and Generation for LLM Parallel Decoding
| Title: | ProPD: Dynamic Token Tree Pruning and Generation for LLM Parallel Decoding |
|---|---|
| Authors: | Zhong, Shuzhang; Yang, Zebin; Gong, Ruihao; Wang, Runsheng; Huang, Ru; Li, Meng |
| Source: | 2024 ACM/IEEE International Conference On Computer Aided Design (ICCAD) Computer Aided Design (ICCAD), 2024 ACM/IEEE International Conference On. :1-8 Oct, 2024 |
| Relation: | 2024 ACM/IEEE International Conference On Computer Aided Design (ICCAD) |
| Database: | IEEE Xplore Digital Library |