1. A Formal Framework for Understanding Length Generalization in Transformers

   Xinting Huang, Andy Yang, Satwik Bhattamishra, Yash Sarrof, and 4 more authors

   arXiv preprint, 2024

   PDF
2. The Expressive Capacity of State Space Models: A Formal Language Perspective

   Yash Sarrof, Yana Veitsman, and Michael Hahn

   NeurIPS 2024 Poster, 2024

   HTML PDF