Yunqiao Yang

When Structured Sparse Autoencoders Learn Consistent Concepts Across Modalities

Weiduo Liao, Yunqiao Yang, Ying Wei

Sparse autoencoders (SAEs) have emerged as a promising technique for mechanistic interpretability by learning a set of sparse latent features in large models, each of which encodes a distinct concept. However, in vision-language models (VLMs), vanilla SAEs struggle to learn modal…Read more