Language & Intelligence Lab

언어지능 연구실

관련기사 바로가기

Since most worldly phenomena can be expressed via language, language is a crucial medium for transferring information and integrating multiple information sources. For example, humans can describe what they see, hear and feel with words. Reversely, they can imagine scenes, sounds and feelings from what they read. Therefore, language plays an important role in solving machine learning (ML) and artificial intelligence (AI) problems with multimodal input sources. In our Language & Intelligence Lab, we study various topics on AI problems regarding NLP and multimodal learning. By addressing the different problems, we aim to build integrated systems that understand language, vision, action, etc.

Major research field

Natural Language Processing, Multimodal Learning

Desired field of research

Explainable/Interpretable AI

Research Keywords and Topics

· Large Language Models (LLMs), Multimodal LLMs
· Embodied AI (navigation, manipulation, etc.)
· Dialogue, Conversation
· Commonsense Reasoning
· Grounding, Compositionality, Interpretability

Research Publications

· Conversation Chronicles: Towards Diverse Temporal and Relational Dynamics in Multi-Session Conversations, Jihyoung Jang, MinSeong Boo, and Hyounghun Kim. Proceedings of EMNLP 2023
· CoSIm: Commonsense Reasoning for Counterfactual Scene Imagination, Hyounghun Kim*, Abhay Zala*, and Mohit Bansal. Proceedings of NAACL 2022
· CAISE: Conversational Agent for Image Search and Editing, Hyounghun Kim, Doo Soon Kim, Seunghyun Yoon, Franck Dernoncourt, Trung Bui, and Mohit Bansal. Proceedings of AAAI 2022
· NDH-Full: Learning and Evaluating Navigational Agents on Full-Length Dialogue, Hyounghun Kim, Jialu Li, and Mohit Bansal. Proceedings of EMNLP 2021
· FixMyPose: Pose Correctional Captioning and Retrieval, Hyounghun Kim*, Abhay Zala*, Graham Burri, and Mohit Bansal. Proceedings of AAAI 2021
· ArraMon: A Joint Navigation-Assembly Instruction Interpretation Task in Dynamic Environments, Hyounghun Kim, Abhay Zala, Graham Burri, Hao Tan, and Mohit Bansal. Findings of EMNLP 2020

Patents

· [출원] 스토리 생성 방법 및 시스템. 김형훈, 배민욱. 2024/06
· [출원] 연대기적 역학 기반의 멀티 세션 대화 모델을 이용하여 챗봇 서비스를 제공하는 전자 장치 및 방법. 김형훈, 장지형. 2024/01

국가과학기술표준분류

  • EE. 정보/통신
  • EE01. 정보이론
  • EE0108. 인공지능