Martin Monperrus

Latent Programming Horizons in Coding Agents

André Silva, Han Tu, Martin Monperrus

A coding agent solving a software-engineering task spends dozens of steps reasoning, editing code, and running tests, yet little is known about what the underlying language model internally represents about the program it is working on. We show that the residual streams of langua…Read more