Teaching/Keynotes
Teaching
UNC Chapel Hill, Spring 2026: COMP690: Multimodal AI: Connecting Language to Vision and Robotics.
UNC Chapel Hill, Spring 2025: COMP590/790: Multimodal AI: Connecting Language to Vision and Robotics.
UNC Chapel Hill, Spring 2023: COMP590/790: Connecting Language to Vision and Robotics.
UNC Chapel Hill, Fall 2021: COMP590/790: Connecting Language to Vision and Robotics.
UNC Chapel Hill, Fall 2020: COMP786: Natural Language Processing.
UNC Chapel Hill, Fall 2019: First-Year Undergraduate Honors Seminar: Special Topics: Human and Artificial Intelligence Through the Prism of Language.
UNC Chapel Hill, Spring 2019: Advanced Topics in NLP: Recent Progress in Different Learning Paradigms.
UNC Chapel Hill, Spring 2018: Advanced Topics in NLP: Conversational Models.
UNC Chapel Hill, Fall 2017: Graduate Natural Language Processing.
UNC Chapel Hill, Spring 2017: Advanced Topics in NLP: Language Grounding for Robotics.
UNC Chapel Hill, Fall 2016: Seminar on Natural Language Processing.
Recent Invited Talks/Keynotes
Distinguished Colloquium, ETH Zurich
ACL Workshop Keynote: Advances in Language and Vision Research (ALVR)
CVPR Workshop Keynotes: (1) Computer Vision in the Wild; (2) Any-to-any Multimodal Learning; (3) Grounded Retrieval & Agentic Intelligence for VL; (4) CV4Edu: Multimodal Vision in Classrooms
Distinguished Speaker Series, University of Virginia
Distinguished Lecture Series, Oracle AI
Distinguished Lecture in AI, Georgetown University
India Keynotes: ACM CODS 2025; CVIP 2025
Keynote, ICDM 2025 Workshop on Reasoning, Agents, Retrieval, and Attribution ['Multimodal Retrieval for Understanding and Generation across Diverse Sources']
Keynote, EMNLP 2025 5th New Frontiers in Summarization Workshop ['Attributable, Conflict-Robust, Multimodal Summarization with Multi-Source Retrieval']
Keynote, ICCV 2025 4th Workshop on What is Next in Multimodal Foundation Models ['Multimodal Generative Models: Unification and Composable Generalization']
Keynote, 28th European Conference on Artificial Intelligence (ECAI), 2025
Distinguished Lecture Series, Virginia Tech
Invited Speaker, Athens NLP Summer School (AthNLP), 2025
Keynote, CVPR 2025 Workshop on Video LLMs ['Generative Multimodal Models: Planning Agents, Skill Learning, and Compositional Generalization': video]
Singapore Keynotes: LM Safety Workshop; Singapore NLP Symposium (SSNLP); Open Multimodal Workshop
Distinguished Lecture Series, MSU
Keynote, Midwest Speech and Language Days (MSLD) 2025
Distinguished Lecture Series, GMU
Keynote, NLP@Michigan Day, 2025
Distinguished Lecture Series, StonyBrook ['Trustworthy Planning Agents for Collaborative Reasoning and Multimodal Generation': video]
Distinguished Speaker Series, USF
Keynote, Amazon Research Days
Keynote, TTIC Multimodal AI Workshop
Keynote, Lisbon Machine Learning Summer School (LxMLS) 2024
USC Distinguished Lecture Series
Keynote, SouthNLP Symposium 2024
IISc Bangalore (Kotak AI-ML Centre)
Keynote, 27th Conference on Computational Natural Language Learning (CoNLL 2023) ['Multimodal Generative LLMs: Unification, Interpretability, Evaluation': video]
Invited Speaker, TTIC 20th Anniversary Celebration
Penn State NLP Colloquium Series
Auburn AI Distinguished Speaker Series, 2023
TWIML AI Podcast: 'Unifying Vision and Language Models'
ACL 2023 Narrative Understanding Workshop
CVPR 2023 Explainable AI for Computer Vision (XAI4CV) Workshop
IBM Neuro-Symbolic AI Workshop 2023 ['Modeling and Evaluating Faithful Generation in Language (and Vision)']
MBZUAI AI Quorum's Inaugural NLP Symposium ['Unified and Efficient Vision-and-Language Modeling': video]
UT Austin Forum for Artificial Intelligence
ICML 2022 Pre-training Workshop ['Unified and Efficient Multimodal Pretraining Across Vision and Language': video]
Keynote, 15th International Conference on Natural Language Generation (INLG 2022) ['Modeling and Evaluating Faithful Generation in Language (and Vision)': video]
Robustness in Sequential Data (ROSE) Workshop, CVPR 2022
Summarization of Creative Text Workshop, COLING 2022
Indian Symposium on Machine Learning (IndoML), 2021
Fact Extraction and VERification (FEVER) Workshop, EMNLP 2021
Closing the Loop Between Vision and Language (CLVL) Workshop, ICCV 2021
Human Interaction for Robotic Navigation Workshop, ICCV 2021
CVIT Summer School on Artificial Intelligence, 2021
Advances in Language and Vision Research (ALVR) Workshop, NAACL 2021
Person in Context Workshop, CVPR 2021
IJCAI 2020 Early Career Spotlight Talk
Singapore Symposium on Natural Language Processing (SSNLP 2020) ['Towards Knowledge-Robust and Multimodally-Grounded NLP': video]
3rd Workshop on Neural Generation and Translation (WNGT @ EMNLP 2019) ['Knowledgeable and Multimodal Language Generation': slides]
1st Workshop on Beyond Vision and Language: Integrating Knowledge from Real-World (LANTERN @ EMNLP 2019) ['Knowledgeable and Dynamic Spatio-Temporal Language+Vision+Robotics': slides]
Workshop on Machine Reading for Question Answering (MRQA @ EMNLP 2019) ['Interpretability and Robustness for Multi-Hop QA': slides]
4th Workshop on Representation Learning for NLP (RepL4NLP @ ACL 2019) ['Knowledgeable and Adversarially-Robust Representation Learning': slides]
RSS-2018 Natural Human-Robot Communication Workshop ['Spatially-Grounded, Personable, and Sensible Human-Robot Communication']
Google Assistant Dialog Workshop
Machine Learning Summer School
SAS-Nvidia Deep Learning Symposium