Mikołaj Słowikowski

Recovering Input Text from Hidden States: Study of Gradient-Based Inversion of Decoder-Only Language Models

Mikołaj Słowikowski, Maciej Witold Majewski

This work studies the hidden-state inversion problem: recovering the original input token sequence of a decoder-only language model from its last-layer hidden states. Rather than treating inversion as a one-shot reconstruction, we study it as a continuous embedding-space optimisa…Read more