Past talk · AI/ML Seminar Series
Hidden Capabilities and Counterintuitive Limits in Large Language Models
PhD Student, School of Computer Science & Engineering, University of Washington
- Date & time
- Monday, April 15, 2024 · 11:00 AM
- Location
- Donald Bren Hall 4011
Abstract
Massive scale has been a recent winning recipe in natural language processing and AI, with extreme-scale language models like GPT-4 receiving most attention. This is in spite of staggering energy and monetary costs, and further, the continuing struggle of even the largest models with concepts such as compositional problem solving and linguistic ambiguity. In this talk, I will propose my vision for a research landscape where compact language models share the forefront with extreme scale models, working in concert with many pieces besides scale, such as algorithms, knowledge, information theory, and more. I will cover alternative ingredients to scale, and discuss counterintuitive disparities in the capabilities of even extreme-scale models, which can meet or exceed human performance in some complex tasks while trailing behind humans in what seem to be much simpler tasks.
About the speaker
Peter West is a PhD candidate in the Paul G. Allen School of Computer Science & Engineering at the University of Washington, working with Yejin Choi. His research is focused on natural language processing and language models, particularly combining language models with elements of knowledge, search algorithms, and information theory to equip compact models with new capabilities. His work has received multiple awards, including best methods paper at NAACL 2022, and outstanding paper awards at ACL and EMNLP in 2023. Previously, Peter received a BSc in computer science from the University of British Columbia.