AWQ: Activation-aware Weight Quantization for On-Device LLM Compression and Acceleration
| Title: | AWQ: Activation-aware Weight Quantization for On-Device LLM Compression and Acceleration |
|---|---|
| Authors: | Lin, Ji; Tang, Jiaming; Tang, Haotian; Yang, Shang; Xiao, Guangxuan; Han, Song |
| Source: | GetMobile: Mobile Computing and Communications. 28(4):12-17 |
| Availability: | http://dl.acm.org/doi/10.1145/3714983.3714987 |
| Database: | ACM Full-Text Collection |