LLMs on Edge: Network Traffic Characteristics of Distributed Inference under the Loupe
| Title: | LLMs on Edge: Network Traffic Characteristics of Distributed Inference under the Loupe |
|---|---|
| Authors: | Buschmann, Philippe; Broering, Arne; Carle, Georg; Blenk, Andreas |
| Source: | Proceedings of the 2nd Workshop on Networks for AI Computing. :108-114 |
| Availability: | http://dl.acm.org/doi/10.1145/3748273.3749213 |
| Database: | ACM Full-Text Collection |