arxivcs.CVcs.AI2026-07-04
Full Glyph Images Beat Token Embeddings: A Controlled Study for Transformers
Modern language models generally represent text as sequences of discrete token embeddings, an assumption deeply rooted in current practice but rarely questioned. We challenge this representation, especially for Chinese, by replacing index-based token embeddings entirely with a si…