PublicationsBorn a Transformer–Always a Transformer? Yana Veitsman, Mayank Jobanputra, Yash Sarrof, Aleksandra Bakalova, and 3 more authors NeurIPS, 2025 PDFA Formal Framework for Understanding Length Generalization in Transformers Xinting Huang, Andy Yang, Satwik Bhattamishra, Yash Sarrof, and 4 more authors ICLR, 2025 PDFThe Expressive Capacity of State Space Models: A Formal Language Perspective Yash Sarrof, Yana Veitsman, and Michael Hahn NeurIPS, 2024 PDFHomophonic Pun Generation in Code Mixed Hindi English Yash Sarrof Computational Humour Workshop, COLING, 2025 PDF