arxivcs.CRcs.AI2026-07-14
Efficient and Privacy Aware Edge Cloud Collaborative Inference for Large Language Models
Cheng Li, Jiexiong Liu, Yixuan Chen, Yi Li
On-device LLM inference faces a trilemma of response latency, limited hardware resources and user privacy. Full cloud inference delivers strong computing power but exposes user prompts and dialogue data, while standalone on-device inference is unfeasible for most consumer and emb…