Sashank Varma

Language Models Represent and Transform Concepts with Shared Geometry

Zhimin Hu, Lanhao Niu, Sashank Varma

How concepts are represented in neural networks is a fundamental question in machine learning. The dominant view treats concept representations as stationary geometric objects. Yet concepts appear in context, and context transforms them. Drawing from neural population geometry, w…Read more