The Surprising Soupability of Documents in State Space Models
Published in arXiv, 2025
This paper investigates the soupability of documents within state space models, revealing surprising properties about how these models handle document mixing.
Recommended citation: Y. Jafari, Z. Wang, L. Bergen, T. Berg-Kirkpatrick. "The Surprising Soupability of Documents in State Space Models." arXiv preprint arXiv:2505.24033.
Download Paper