Department of Computer Science & Engineering

Publications : (Last Five, while at IITM)View All

• The Heads Hypothesis: A Unifying Statistical Approach Towards Understanding Multi-Headed Attention in BERT. 
  
  Authors : Madhura Pande, Aakriti Budhraja, Preksha Nema, Pratyush Kumar, Mitesh Khapra
  Appeared in Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2-9, 2021, pp.13613-13621, Feb 2021
• On the weak link between importance and prunability of attention heads. 
  
  Authors : Aakriti Budhraja, Madhura Pande, Preksha Nema, Pratyush Kumar, Mitesh Khapra
  Appeared in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020 (EMNLP 2020) ,pp.3230-3235, Nov 2020

(Recent) Teaching Assistantship : View All  |  Back to top