Publications

You can also find articles on my Google Scholar profile.

(The * indicates equal contribution, ^† indicates the mentoring role)

arxiv:2509.21016RL Grokking Recipe: How Does RL Unlock and Transfer New Algorithms in LLMs?
Yiyou Sun, Yuhan Cao, Pohao Huang, Haoyue Bai, Hannaneh Hajishirzi, Nouha Dziri, Dawn Song

Paper Blog@BerkeleyRDI Twitter (❤️ 1K)

arxiv:2507.21017MIRAGE-Bench: LLM Agent is Hallucinating and Where to Find Them
Weichen Zhang*, Yiyou Sun*, Pohao Huang, Jiayue Pu, Heyue Lin, Dawn Song

NeurIPS'25OMEGA: Can LLMs Reason Outside the Box in Math? Evaluating Exploratory, Compositional, and Transformative Generalization
Yiyou Sun, Shawn Hu, Georgia Zhou, Ken Zheng, Hannaneh Hajishirzi, Nouha Dziri, Dawn Song

Paper Blog@AI2 Twitter (❤️ 700)

NeurIPS'25Why and how llms hallucinate: Connecting the dots with subsequence associations
Yiyou Sun, Yugai Gai, Lijie Chen, Abhilasha Ravichander, Yejin Choi, Dawn Song

arxiv:2504.11741Climbing the Ladder of Reasoning: What LLMs Can-and Still Can't-Solve after SFT?
Yiyou Sun, Georgia Zhou, Hao Wang, Dacheng Li, Nouha Dziri, Dawn Song

arxiv:2501.03491Can LLMs Design Good Questions Based on Context?
Yueheng Zhang, Xiaoyuan Liu, Yiyou Sun, Atheer Alharbi, Hend Alzahrani, Basel Alomair, Dawn Song

ACL'25SAUP: Situation Awareness Uncertainty Propagation on LLM Agent
Qiwei Zhao, Xujiang Zhao, Yanchi Liu, Wei Cheng, Yiyou Sun, Mika Oishi, Takao Osaki, Katsushi Matsuda, Huaxiu Yao, Haifeng Chen

CVPR'25Where's the liability in the Generative Era? Recovery-based Black-Box Detection of AI-Generated Content
Haoyue Bai, Yiyou Sun^†, Wei Cheng, Haifeng Chen

ICLR'25Chain-of-region: Visual Language Models Need Details for Diagram Analysis
Xue Li*, Yiyou Sun*, Wei Cheng, Yinglun Zhu, Haifeng Chen

ICLR'25Scattered Forest Search: Smarter Code Space Exploration with LLMs
Jonathan Light, Yue Wu, Yiyou Sun, Wenchao Yu, Yanchi Liu, Xujiang Zhao, Ziniu Hu, Haifeng Chen, Wei Cheng

NeurIPS'24Revisiting Score Propagation in Graph Out-of-Distribution Detection
Longfei Ma*, Yiyou Sun*^†, Kaize Ding, Zemin Liu, Fei Wu

NeurIPS'24Improving Logits-based Detector without Logits from Black-box LLMs
Cong Zeng, Shengkun Tang, Xianjun Yang, Yuanzhou Chen, Yiyou Sun, zhiqiang xu, Yao Li, Haifeng Chen, Wei Cheng, Dongkuan Xu

ICML'24Chatbot Meets Pipeline: Augment Large Language Model with Definite Finite Automaton
Yiyou Sun, Junjie Hu, Wei Cheng, Haifeng Chen

ICML'24When and How Does In-Distribution Label Help Out-of-Distribution Detection?
Xuefeng Du, Yiyou Sun, Yixuan Li

NAACL'24Uncertainty Decomposition and Quantification for In-Context Learning of Large Language Models
Chen Ling, Xujiang Zhao, Xuchao Zhang, Wei Cheng, Yanchi Liu, Yiyou Sun, Mika Oishi, Takao Osaki, Katsushi Matsuda, Jie Ji, Guangji Bai, Liang Zhao, Haifeng Chen

AAAI'24How to Overcome Curse-of-Dimensionality for OOD Detection?
Soumya Suvra Ghosal*, Yiyou Sun*, Yixuan Li

NeurIPS'23SpotlightA Graph-Theoretic Framework for Understanding Open-World Representation Learning
Yiyou Sun, Zhenmei Shi, Yixuan Li

NeurIPS'23Dream the Impossible: Outlier Imagination with Diffusion Models
Xuefeng Du, Yiyou Sun, Xiaojin Zhu, Yixuan Li

ICML'23When and How Does Known Class Help Discover Unknown Ones? Provable Understandings Through Spectral Analysis
Yiyou Sun, Zhenmei Shi, Yingyu Liang, Yixuan Li

Paper Code Video

CVPR'23Rethinking Domain Generalization for Face Anti-spoofing: Separability and Alignment
Yiyou Sun, Yaojie Liu, Xiaoming Liu, Yixuan Li, Wen-Sheng Chu

TMLR'23OpenCon: Open-world Contrastive Learning
Yiyou Sun, Yixuan (Sharon) Li

ICLR'23How to Exploit Hyperspherical Embeddings for Out-of-Distribution Detection?
Yifei Ming, Yiyou Sun, Ousmane Dia, Yixuan (Sharon) Li

ICML'22Out-of-distribution Detection with Deep Nearest Neighbors
Yiyou Sun, Yifei Ming, Xiaojin Zhu, Yixuan (Sharon) Li

Paper Code Slides Twitter (❤️ 600)

ECCV'22DICE: Leveraging Sparsification for Out-of-Distribution Detection
Yiyou Sun, Yixuan (Sharon) Li

Paper Code Poster Video

NeurIPS'21ReAct: Out-of-distribution Detection With Rectified Activations
Yiyou Sun, Chuan Guo, Yixuan (Sharon) Li

Paper Code Slides

NeurIPS'22Delving into OOD Detection with Vision-Language Representations
Yifei Ming, Ziyang Cai, Jiuxiang Gu, Yiyou Sun, Wei Li, Yixuan (Sharon) Li

NeurIPS'22OpenOOD: Benchmarking Generalized Out-of-Distribution Detection (Datasets and Benchmarks Track)
Jingkang Yang, Pengyun Wang, Dejian Zou, Zitang Zhou, Kunyuan Ding, Wenxuan Peng, Haoqi Wang, Guangyao Chen, Bo Li, Yiyou Sun, Xuefeng Du, Kaiyang Zhou, Wayne Zhang, Dan Hendrycks, Yixuan (Sharon) Li, Ziwei Liu

ICCV'19Adaptive Activation Thresholding: Dynamic Routing Type Behavior for Interpretability in Convolutional Neural Networks
Yiyou Sun, Sathya Ravi, Vikas Singh

Paper Webpage Code

ECCV'18Interpretable Basis Decomposition for Visual Explanation
Bolei Zhou*, Yiyou Sun*, David Bau*, Antonio Torralba

arxiv:1806.02891Revisiting the Importance of Individual Units in CNNs via Ablation
Bolei Zhou, Yiyou Sun, David Bau, Antonio Torralba

AIM'17Faster R-CNN based autonomous navigation for vehicles in warehouse
Yiyou Sun, Tonghua Su, Zhiying Tu

ICML'21 WSSpotlight LOOD: Localization-based Uncertainty Estimation for Medical Imaging (Spotlight)
Yiyou Sun, Bastin Joseph, Alison Deatsch, Robert Jeraj, Yixuan (Sharon) Li

IEEE DEBThe Periodic Table of Data Structures
Stratos Idreos, Kostas Zoumpatianos, Manos Athanassoulis, Niv Dayan, Brian Hentschel, Michael S. Kester, Demi Guo, Lukas Maas, Wilson Qin, Abdul Wasay, Yiyou Sun

IEEE DEBLearning Data Structure Alchemy
Stratos Idreos, Kostas Zoumpatianos, Subarna Chatterjee, Wilson Qin, Abdul Wasay, Brian Hentschel, Mike Kester, Niv Dayan, Demi Guo, Minseo Kang, Yiyou Sun