Huaxiu Yao (姚骅修)

[1] Yiyang Zhou*, Zhiyuan Fan*, Dongjie Cheng*, Sihan Yang, Zhaorun Chen, Chenhang Cui, Xiyao Wang, Yun Li, Linjun Zhang, Huaxiu Yao, Calibrated Self-Rewarding Vision Language Models, arXiv 2405.14622. [arXiv] [Code]

[AI Alignment], [Multimodal]

[2] Zhaorun Chen*, Yichao Du*, Zichen Wen*, Yiyang Zhou*, Chenhang Cui, Zhenzhen Weng, Haoqin Tu, Chaoqi Wang, Zhengwei Tong, Qinglan Huang, Canyu Chen, Qinghao Ye, Zhihong Zhu, Yuqing Zhang, Jiawei Zhou, Zhuokai Zhao, Rafael Rafailov, Chelsea Finn, Huaxiu Yao, MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?, arXiv 2407.04842. [arXiv] [Project Page]

[AI Alignment], [Multimodal]

[3] Yiyang Zhou*, Chenhang Cui*, Rafael Rafailov, Chelsea Finn, Huaxiu Yao, Aligning Modalities in Vision Large Language Models via Preference Fine-tuning, arXiv 2402.11411. [arXiv] [Code]

[AI Alignment], [Multimodal]

[4] Taiming Lu*, Lingfeng Shen*, Xinyu Yang*, Weiting Tan, Beidi Chen, Huaxiu Yao, It Takes Two: On the Seamlessness between Reward and Policy Model in RLHF, arXiv 2406.07971. [arXiv]

[AI Alignment]

[5] Peng Xia*, Kangyu Zhu*, Haoran Li, Hongtu Zhu, Yun Li, Gang Li, Linjun Zhang, Huaxiu Yao, RULE: Reliable Multimodal RAG for Factuality in Medical Vision Language Models, arXiv 2407.05131. [arXiv] [Code]

[AI Alignment], [Multimodal], [Health]

[6] Peng Xia, Ze Chen, Juanxi Tian, Yangrui Gong, Ruibo Hou, Yue Xu, Zhenbang Wu, Zhiyuan Fan, Yiyang Zhou, Kangyu Zhu, Wenhao Zheng, Zhaoyang Wang, Xiao Wang, Xuchao Zhang, Chetan Bansal, Marc Niethammer, Junzhou Huang, Hongtu Zhu, Yun Li, Jimeng Sun, Zongyuan Ge, Gang Li, James Zou, Huaxiu Yao, CARES: A Comprehensive Benchmark of Trustworthiness in Medical Vision Language Models, arXiv 2406.06007. [arXiv] [Code]

[Multimodal], [Health]

[7] Chenhang Cui*, Yiyang Zhou*, Xinyu Yang, Shirley Wu, Linjun Zhang, James Zou, Huaxiu Yao, Holistic Analysis of Hallucination in GPT-4V(ision): Bias and Interference Challenges, arXiv 2311.03287. [arXiv] [Code]

[Multimodal]

[1] Xiyao Wang, Yuhang Zhou, Xiaoyu Liu, Hongjin Lu, Yuancheng Xu, Feihong He, Jaehong Yoon, Taixi Lu, Gedas Bertasius, Mohit Bansal, Huaxiu Yao†, Furong Huang†, Mementos: A Comprehensive Benchmark for Multimodal Large Language Model Reasoning over Image Sequences, in Proceeding of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024), Bangkok, Thailand, Aug 2024. [arXiv] [Code]

[Multimodal]

[2] Haoqin Tu*, Chenhang Cui*, Zijun Wang*, Yiyang Zhou, Bingchen Zhao, Junlin Han, Wangchunshu Zhou, Huaxiu Yao, Cihang Xie, How Many Unicorns Are in This Image? A Safety Evaluation Benchmark for Vision LLMs, in Proceeding of the 18th European Conference on Computer Vision (ECCV 2024), Milan, Italy, Sept 2024. [arXiv] [Code]

[AI Alignment], [Out-of-Distribution Robustness], [Multimodal]

[3] Zhaorun Chen, Zhuokai Zhao, Hongyin Luo, Huaxiu Yao, Bo Li, Jiawei Zhou, HALC: Object Hallucination Reduction via Adaptive Focal-Contrast Decoding, in Proceeding of the Forty-first International Conference on Machine Learning (ICML 2024), Vienna, Austria, July 2024. [Paper] [Code]

[AI Alignment], [Multimodal]

[4] Xu Yang, Huaxiu Yao, Ying Wei, One Meta-tuned Transformer is What You Need for Few-shot Learning, in Proceeding of the Forty-first International Conference on Machine Learning (ICML 2024), Vienna, Austria, July 2024 (Spotlight).

[Meta-Learning]

[5] Yiyang Zhou*, Chenhang Cui*, Jaehong Yoon, Linjun Zhang, Zhun Deng, Chelsea Finn, Mohit Bansal, Huaxiu Yao, Analyzing and Mitigating Object Hallucination in Large Vision-Language Models, in Proceeding of the 12th International Conference on Learning Representations (ICLR 2024), Vienna, Austria, May 2024  (the short version is presented in NeurIPS 2023 Instruction Workshop). [Paper] [Code]

[AI Alignment], [Out-of-Distribution Robustness]

[6] Huaxiu Yao*, Xinyu Yang*, Xinyi Pan, Shengchao Liu, Pang Wei Koh, Chelsea Finn, Improving Domain Generalization with Domain Relations, in Proceeding of the 12th International Conference on Learning Representations (ICLR 2024), Vienna, Austria, May 2024 (Spotlight). [Paper]

[AI Alignment], [Out-of-Distribution Robustness]

[7] Katherine Tian*, Eric Mitchell*, Huaxiu Yao, Christopher D Manning, Chelsea Finn, Fine-Tuning Language Models for Factuality, in Proceeding of the 12th International Conference on Learning Representations (ICLR 2024), Vienna, Austria, May 2024  (the short version is presented in NeurIPS 2023 Instruction Workshop). [Paper]

[AI Alignment]

[8] Xiaohui Zhang, Jaehong Yoon, Bansal Mohit, Huaxiu Yao, Multimodal Representation Learning by Alternating Unimodal Adaptation, in Proceeding of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024 (CVPR 2024), Seattle, WA, Jun 2024. [Paper]

[Multimodal]

[9] Caroline Choi*, Fahim Tajwar*, Yoonho Lee*, Huaxiu Yao, Ananya Kumar, Chelsea Finn, Conservative Prediction via Data-Driven Confidence Minimization, Transactions on Machine Learning Research (TMLR), 2024. [Paper]

[Out-of-Distribution Robustness]

[10] Percy Liang, Rishi Bommasani, Tony Lee, [and 47 others, including Huaxiu Yao], Holistic Evaluation of Language Models, Transactions on Machine Learning Research (TMLR, Featured), 2023. [Paper] [Project Page]

[AI Alignment]

[11] Katherine Tian*, Eric Mitchell*, Allan Zhou, Archit Sharma, Rafael Rafailov, Huaxiu Yao, Chelsea Finn, Christopher D Manning, Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedback, in Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023), Singapore, Dec. 2023 (Short Paper). [Paper]

[AI Alignment]

[12] Zhenbang Wu, Huaxiu Yao, David Liebovitz, Jimeng Sun, An Iterative Self-Learning Framework for Medical Domain Generalization, in Proceeding of the Thirty-Seventh Conference on Neural Information Processing Systems (NeurIPS 2023), New Orleans, LA, Dec. 2023. [Paper]

[Out-of-Distribution Robustness], [Health]

[13] Yoonho Lee, Huaxiu Yao, Chelsea Finn, Diversify and Disambiguate: Learning From Underspecified Data, in Proceeding of the 11th International Conference on Learning Representations (ICLR 2023), Kigali, Rwanda, May 2023 (the short version is presented in ICML 2022 Workshop on Spurious correlations, Invariance, and Stability and Workshop on Principles of Distribution Shift). [Paper] [Code]

[Out-of-Distribution Robustness]

[14] Yoonho Lee*, Annie S. Chen*, Fahim Tajwar, Ananya Kumar, Huaxiu Yao, Percy Liang, Chelsea Finn, Surgical Fine-Tuning Improves Adaptation to Distribution Shifts, in Proceeding of the 11th International Conference on Learning Representations (ICLR 2023), Kigali, Rwanda, May 2023 (the short version is presented in NeurIPS 2022 I Can't Believe It's Not Better Workshop and Workshop on Distribution Shifts). [Paper] [Code]

[AI Alignment], [Out-of-Distribution Robustness]

[15] Xinzhe Zuo, Zixiang Chen, Huaxiu Yao, Yuan Cao, Quanquan Gu, Understanding Train-Validation Split in Meta Learning with Neural Networks, in Proceeding of the 11th International Conference on Learning Representations (ICLR 2023), Kigali, Rwanda, May 2023. [Paper]

[Meta-Learning]

[16] Huaxiu Yao*, Yiping Wang*, Linjun Zhang, James Zou, Chelsea Finn, C-Mixup: Improving Generalization in Regression, in Proceeding of the Thirty-Sixth Conference on Neural Information Processing Systems (NeurIPS 2022), New Orleans, LA, Dec. 2022. [Paper] [Code] [Video] [Bilibili] [Slides]

[Out-of-Distribution Robustness]

[17] Huaxiu Yao*, Caroline Choi*, Bochuan Cao, Yoonho Lee, Pang Wei Koh, Chelsea Finn, Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Time, in Proceeding of the Thirty-Sixth Conference on Neural Information Processing Systems Track on  Datasets & Benchmarks (NeurIPS 2022), New Orleans, LA, Dec. 2022. [Paper] [Code] [Website] [Video] [Bilibili] [Slides]

[Out-of-Distribution Robustness]

[18] Huaxiu Yao*, Yu Wang*, Sai Li, Linjun Zhang, Weixin Liang, James Zou, Chelsea Finn, Improving Out-of-Distribution Robustness via Selective Augmentation, in Proceeding of the Thirty-ninth International Conference on Machine Learning (ICML 2022), Baltimore, MD, July 2022. [Paper] [Code] [Video] [Bilibili] [Slides]

[AI Alignment], [Out-of-Distribution Robustness]

[19] Huaxiu Yao, Linjun Zhang, Chelsea Finn, Meta-Learning with Fewer Tasks through Task Interpolation, in Proceeding of the 10th International Conference on Learning Representations (ICLR 2022), Virtual, Apr. 2022 (Oral, 54/3391). [Paper] [Code] [Slides]

[Meta-Learning]

[20] Huaxiu Yao*, Yu Wang*, Ying Wei, Peilin Zhao, Mehrdad Mahdavi, Defu Lian, Chelsea Finn, Meta-learning with an Adaptive Task Scheduler, in Proceeding of the Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS 2021), Virtual, Dec. 2021. [Paper] [Code] [Slides]

[Meta-Learning]

[21] Huaxiu Yao, Ying Wei, Longkai Huang, Ding Xue, Junzhou Huang, Zhenhui Li, Functionally Regionalized Knowledge Transfer for Low-resource Drug Discovery, in Proceeding of the Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS 2021), Virtual, Dec. 2021. [Paper][Code] [Slides]

[Meta-Learning], [Health]

[22] Huaxiu Yao*, Longkai Huang*, Linjun Zhang, Ying Wei, Li Tian, James Zou, Junzhou Huang, Zhenhui Li, Improving Generalization in Meta-learning via Task Augmentation, in Proceeding of the Thirty-eighth International Conference on Machine Learning (ICML 2021), Virtual, Jul. 2021. [Paper] [Code] [Slides]

[Meta-Learning]

[23] Huaxiu Yao, Yingbo Zhou, Mehrdad Mahdavi, Zhenhui Li, Richard Socher, Caiming Xiong, Online Structured Meta-learning, in Proceeding of the Thirty-fourth Conference on Neural Information Processing Systems (NeurIPS 2020), Virtual, Dec. 2020. [Paper] [Slides]

[Meta-Learning]

[24] Huaxiu Yao, Xian Wu, Zhiqiang Tao, Yaliang Li, Bolin Ding, Ruirui Li, Zhenhui Li, Automated Relational Meta-learning, in Proceeding of the Eighth International Conference on Learning Representations (ICLR 2020), Virtual, Apr. 2020. [Paper] [Code] [Slides]

[Meta-Learning]

[25] Huaxiu Yao, Ying Wei, Junzhou Huang, Zhenhui Li, Hierarchically Structured Meta-learning, in Proceeding of the 36th International Conference on Machine Learning (ICML 2019), Long Beach, CA, June 2019. [Paper] [Code] [Slides]

[Meta-Learning]

[Fall 2024 - now] Yiyang Zhou, Achievement: ICLR'24a, ECCV'24, preprint'23*2, preprint'24*2

[Fall 2024 - now] Zhaoyang Wang

[Fall 2024 - now] Wenhao Zheng, Achievement: preprint'24

[Fall 2024 - now] Peng Xia, visiting PhD student, Achievement: MICCAI'24, preprint'24

[2024 - now] Zhiyuan Fan, independent researcher (gap year), Achievement: preprint'24

[2024 - now] Siwei Han (she/her), undergrad@Fudan U, Achievement: ICML'24

[2024 - now] Dongjie Cheng, independent researcher, Achievement: preprint'24

[2023 - now] Chenhang Cui, independent researcher, Achievement: ICLR'24a, ECCV'24, preprint'23*2, preprint'24*2

[2023 - now] Zhaorun Chen, M.S. student@Purdue -> Ph.D. student@UChicago, Achievement: ICML'24, NAACL'24, preprint'24

[2023] Qichuan Yin, undergrad@PKU -> Ph.D. student@UChicago, Achievement: preprint'23

[2023] Taixi Lu, undergrad@UNC -> Amazon, Achievement: preprint'24

[2023] Haoqiang Kang, undergrad@UW -> Ph.D. student@UCSD, Achievement: preprint'23a

[2023] Kartherina Tian (she/her), undergrad@Harvard, Achievement: preprint'23a

[2023] Xiaohui Zhang, M.S.@BJTU -> Ph.D. student@Notre Dame, Achievement: CVPR'24

[2022] Fahim Tajwar, undergrad@Stanford -> Ph.D. student@CMU, Achievement: preprint'23a

[2022 - 2023] Zhenbang Wu, Ph.D. student@UIUC, co-mentored with Prof. Jimeng Sun, Achievement: preprint'22a, NeurIPS'23

[2022 - 2023] Xinyu Yang, undergrad@SJTU -> Ph.D. student@CMU, Achievements: TMLR'23b, preprint'22a

[2022] Caroline Choi (she/her), undergrad@Stanford, Achievement: NeurIPS'22b

[2022] Yiping Wang, undergrad@ZJU -> Ph.D. student@UW, Achievement: NeurIPS'22a

[2022] Zhiyu Xie (she/her), undergrad@THU -> MS student@Stanford, Achievements: preprint'23a

[2021 - 2022] Bochuan Cao, undergrad@UESTC -> Ph.D. student@PSU, Achievement: NeurIPS'22b

[2021 - 2022] Yu Wang, undergrad@USTC -> Ph.D. student@UCSD, Achievements: NeurIPS'21a, ICML'22

[2021] Yingxin Wu (she/her), undergrad@USTC -> Ph.D. student@Stanford, Achievement: EMNLP'21

[2021] Yingxiu Zhao (she/her), Ph.D. student@HKUST, co-mentored with Prof. Nevin Zhang, Achievement: ACL'22

[2020] Jiatu Shi (industry practitioner), senior engineer@Alibaba -> senior engineer@ByteDance, Achievement: WSDM'21

[2019] Xinshi Zang, undergrad@SJTU -> Ph.D. student@CUHK, Achievement: AAAI'20

• International Conference on Machine Learning (ICML), 2024
• Conference on Neural Information Processing Systems (NeurIPS), 2024; D&B Track (2022 - 2024)
• International Conference on Learning Representations (ICLR), 2025
• International Conference on Artificial Intelligence and Statistics (AISTATS), 2024
• Empirical Methods in Natural Language Processing  (EMNLP), 2024
• International Conference on Automated Machine Learning (AutoML-Conf), 2022 - 2024
• Learning on Graphs Conference (LoG), 2022 - 2024

• Organizer, Workshop on Foundation Models in the Wild, ICML 2024 (Co-organizers: Xinyu Yang, Bilge Acun, Kamalika Chaudhuri, Beidi Chen, Giulia Fanti, Junlin Han, Lianhui Qin, Shengbang Tong, Philip Torr, Hao Wang, Cathy Wu, James Zou)
• Lead Organizer, Workshop on Reliable and Responsible Foundation Models, ICLR 2024 (Co-organizers: Mohit Bansal, Zhun Deng, Chelsea Finn, Pavel Izmailov, He He, Pang Wei Koh, Eric Mitchell, Cihang Xie) [Website]
• Lead Organizer, Sixth Workshop on Meta-Learning, NeurIPS 2022 (Co-organizers: Fábio Ferreira, Frank Hutter, Joaquin Vanschoren, Eleni Triantafillou, Qi Lei) [Website]
• Lead Organizer, the First Workshop on Pre-training: Perspectives, Pitfalls, and Paths Forward, ICML 2022 (Co-organizers: Hugo Larochelle, Colin Rafel, Percy Liang, Jian Tang, Ying Wei, Saining Xie, Eric P. Xing, Chelsea Finn) [Website]
• Organizer, Fifth Workshop on Meta-Learning, NeurIPS 2021 (Co-organizers: Fábio Ferreira, Erin Grant, Frank Hutter, Jonathan Schwarz, Joaquin Vanschoren) [Website]