EdgeLoRA: An Efficient Multi-Tenant LLM Serving System on Edge Devices
| Title: | EdgeLoRA: An Efficient Multi-Tenant LLM Serving System on Edge Devices |
|---|---|
| Authors: | Shen, Zheyu; He, Yexiao; Wang, Ziyao; Zhang, Yuning; Sun, Guoheng; Ye, Wanghao; Li, Ang |
| Source: | Proceedings of the 23rd Annual International Conference on Mobile Systems, Applications and Services. :138-153 |
| Availability: | http://dl.acm.org/doi/10.1145/3711875.3729141 |
| Database: | ACM Full-Text Collection |