Zhenyu Liu

A Theoretical Interpretation of In-Context Learning via Probabilistic Modeling

Zhenyu Liu, Huaze Tang, Shao-Lun Huang

In-context learning (ICL) is an emerging paradigm that employs the semantic information inherent in large language models (LLMs) for generating answers to user queries. While the remarkable performance of ICL has been widely known, a general modeling and a rigorous theoretical an…Read more