Publications Born a Transformer–Always a Transformer? Yana Veitsman, Mayank Jobanputra, Yash Sarrof, Aleksandra Bakalova, and 3 more authors NeurIPS, 2025 PDF A Formal Framework for Understanding Length Generalization in Transformers Xinting Huang, Andy Yang, Satwik Bhattamishra, Yash Sarrof, and 4 more authors ICLR, 2025 PDF The Expressive Capacity of State Space Models: A Formal Language Perspective Yash Sarrof, Yana Veitsman, and Michael Hahn NeurIPS, 2024 PDF Homophonic Pun Generation in Code Mixed Hindi English Yash Sarrof Computational Humour Workshop, COLING, 2025 PDF