I'm a PhD student at Northeastern University where I'm advised by Byron Wallace. Broadly, I'm interested in investigating language model behaviors. More specifically, language models can precisely generalize on unseen data or pick up on behaviors even though we don't explicitly teach them these behaviors. Where do these abilities come from, and why are models predisposed to pick up on these cues? To this end, I use various tools, in training dynamics and interpretability, to measure and reason about how these behaviors arise. I'm grateful to be supported by a Khoury PhD Fellowship and the NSF GRFP.
Before my PhD, I spent time at FAIR/Meta AI as an AI Resident, working with Marjan Ghazvininejad and Mike Lewis, and at Microsoft Research, working with Tristan Naumann. And even before this, I was an undergrad at the University of Washington working with Shwetak Patel on ubiquitous computing and Noah Smith on natural language processing.
New preprint on my paper, Multi-Field Adaptive Retrieval, done during my internship at Microsoft Semantic Machines!
We've released a new preprint on causal interpretability, The Quest for the Right Mediator: A History, Survey, and Theoretical Grounding of Causal Interpretability - work done with David Bau's interpretability group.
I've accepted an internship offer with Microsoft Semantic Machines for the upcoming summer, working with Patrick Xia and Tongfei Chen.
Our paper on Function Vectors in Large Language Models was accepted to ICLR 2024!
Our paper, Summarizing, Simplifying, and Synthesizing Medical Evidence using GPT-3 (with Varying Success), was accepted to ACL 2023!
I was awarded a 2022 NSF Graduate Research Fellowship. Northeastern wrote an article about it here.
Started as an AI Resident with Fundamental AI Research (FAIR) at Meta in Seattle, working on natural language processing and human-computer interaction research for a year.
Started my internship at Microsoft Research working with Tristan Naumann on the intersection of natural language processing and healthcare!
Excited to announce that I’ll be starting my PhD in the Khoury College of Computer Sciences at Northeastern University in Boston, fall of 2022. Thanks to everyone who has supported me on this journey thus far!
I was awarded an Honorable Mention for the 2021 NSF Graduate Research Fellowship competition.