Jaeyoon Jung

About

Hi, I'm an undergraduate student at Soongsil University and works at MAUM.AI as a senior AI research scientist with a broad interest in artificial intelligence. My current research focuses on several key areas:

Multimodal models capable of handling diverse inputs and outputs (including video, image, text, audio, and action)
Fact-checking using large language and vision-language models
Adapting instruction-following capabilities of English-based large language models to Korean and other languages

Publications

(*: Equal contribution, C: Conferences, J: Journal, W: Workshop, P: Preprint).

2026

[P5] VILLAIN at AVerImaTeC: Verifying Image–Text Claims via Multi-Agent Collaboration

Jaeyoon Jung*, Yejun Yoon*, Seunghyun Yoon, Kunwoo Park

Under Review

Code

[P4] CostNav: A Navigation Benchmark for Cost-Aware Evaluation of Embodied Agents

Haebin Seong, Sungmin Kim, Minchan Kim, Yongjun Cho, Myunchul Joe, Suhwan Choi, Jaeyoon Jung, Jiyong Youn, Yoonshik Kim, Samwoo Seong, Yubeen Park, Youngjae Yu, Yunsung Lee

Under Review

Arxiv Website Code

[P3][W6] Is a Picture Worth a Thousand Words? Agentic Multimodal Fact-Checking for Adaptive Use of Visual Evidence

Jaeyoon Jung, Yejun Yoon, Kunwoo Park

Under Review

Workshop on Human-Centric AI at CIKM, 2025

[P2] Scaling Vision-Action Pretraining on Desktop Data for Transfer to Embodied AI

Suhwan Choi*, Jaeyoon Jung*, Haebin Seong*, Minchan Kim, Minyeong Kim, Yongjun Cho, Yoonshik Kim, Park Yu Been, Youngjae Yu, and Yunsung Lee

Under Review

Arxiv Website Code

[P1] Exploring Fine-Tuning of Large Audio Language Models for Spoken Language Understanding under Limited Speech Data

Youngwon Choi, Jaeyoon Jung, Hyeonyu Kim, Huu-Kim Nguyen, Hwayeon Kim

Under Review

Arxiv

2025

[W5] Team HUMANE at AVeriTeC 2025: HerO 2 for Efficient Fact Verification

Yejun Yoon, Jaeyoon Jung, Seunghyun Yoon, Kunwoo Park

Eighth Workshop on Fact Extraction and VERification (FEVER) at ACL, 2025

Arxiv Code

[C3] Hypothetical Documents or Knowledge Leakage? Rethinking LLM-based Query Expansion

Yejun Yoon, Jaeyoon Jung, Seunghyun Yoon, Kunwoo Park

Findings of the Association for Computational Linguistics (ACL Findings), 2025

Arxiv

[W4] KOFFVQA: An Objectively Evaluated Free-form VQA Benchmark for Large Vision-Language Models in the Korean Language

Yoonshik Kim*, Jaeyoon Jung*

IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2025

Arxiv Website Code Data

[C2][W3] CANVAS: Commonsense-Aware Navigation System for Intuitive Human-Robot Interaction

Suhwan Choi*, Yongjun Cho*, Minchan Kim*, Jaeyoon Jung*, Myunchul Joe, Yubeen Park, Minseo Kim, Sungwoong Kim, Sungjae Lee, Hwiseong Park, Jiwan Chung, Youngjae Yu

International Conference on Robotics and Automation (ICRA), 2025

Workshop on Open-World Agents at NeurIPS, 2024, (Oral, Outstanding Paper Award (3/97 = 3.1%))

Arxiv Website Code Data

2024

[W2] The Herd of Open LLMs for Verifying Real-World Claims

Yejun Yoon*, Jaeyoon Jung*, Seunghyun Yoon, Kunwoo Park

Seventh Workshop on Fact Extraction and VERification (FEVER) at EMNLP, 2024, (Oral)

Arxiv Code

[W1] EnCLAP++: Analyzing the EnCLAP Framework for Optimizing Automated Audio Captioning Performance

Jaeyeon Kim, Minjeon Jeon, Jaeyoon Jung, Sang Hoon Woo, Jinjoo Lee

Detection and Classification of Acoustic Scenes and Events (DCASE) Workshop, 2024

Arxiv

[C1] EnCLAP: Combining Neural Audio Codec and Audio-Text Joint Embedding for Automated Audio Captioning

Jaeyeon Kim, Jaeyoon Jung, Jinjoo Lee, Sang Hoon Woo

IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024

Arxiv Code

Education

Soongsil University Mar. 2020 - Feb. 2026

B.S. in Artificial Intelligence GPA: 4.19/4.5, currently 2nd/100

includes a 2-year mandatory alternative military service at MAUM.AI

Awards

Selected
All

AVerImaTeC shared task hosted by the ninth FEVER workshop at EACL 2026, 1st Place December 2025

Built multimodal fact-checking pipeline with agentic multimodal models Code

PokéAgent Challenge at NeurIPS 2025, 5th Place, Judge's Choice Award November 2025

Track 2: speedrunning, long-horizon RPG gameplay Code

AVeriTeC shared task hosted by the eight FEVER workshop at ACL 2025, 2nd Place May 2025

Enhanced fact-checking pipeline using new retrieval method and quantization Code

AVeriTeC shared task hosted by the seventh FEVER workshop at EMNLP 2024, 2nd Place August 2024

Built fact-checking pipeline with open LLMs, selected as baseline for eighth workshop Code

Detection and Classification of Acoustic Scenes and Events 2024 Challenge, 2nd Place June 2024

Task 6: Automated Audio Captioning, and Task 8: Language-Based Audio Retrieval

NeurIPS 2024 - Open World Agent Workshop, Outstanding Paper Award December 2024

For paper 'CANVAS: Commonsense-Aware Navigation System for Intuitive Human-Robot Interaction'

LG Display Product Quality Classification (LG Aimers 2), 1st Place March 2023

Robust regressor and fitted classifier ensemble with custom hard voting, avoiding overfitting Code

Samsung AI Challenge (3D Metrology), 1st Place October 2022

CycleGAN for unpaired domain transfer and KNN-based depth map prediction from SEM images Code

LG Innotek Radar Performance Prediction (LG Aimers 1), 2nd Place September 2022

Tabular data analysis with domain knowledge and SHAP values, boosting ensemble with stratified k-fold Code

AVerImaTeC shared task hosted by the ninth FEVER workshop at EACL 2026, 1st Place December 2025

Built multimodal fact-checking pipeline with agentic multimodal models Code

PokéAgent Challenge at NeurIPS 2025, 5th Place, Judge's Choice Award November 2025

Track 2: speedrunning, long-horizon RPG gameplay Code

5th Uni-DTHON Challenge, 1st Place November 2025

Datathon track: Build a pipeline that detect and localize the user-requested table/chart with a bounding box. Code