Kangyu's Homepage

Machine Learning Researcher  |  Agentic AI · Trustworthy ML · Multimodal LLMs

IMG_6982.JPG

kangyu_zhu at brown dot edu

70 Brown Street

Providence, RI 02912

Hello! I am Kangyu Zhu, a machine learning researcher working on the reliability and trustworthiness of multimodal large language models and agentic AI. I am currently at TikTok, where I build agentic AI systems for high-stakes real-world applications.

I received my Master of Science degree in Computer Science at Brown University. Before joining Brown in 2023, I earned dual degrees in Electrical Engineering from Zhejiang University and University of Illinois Urbana-Champaign.

Research Background

My research centers on reliable and trustworthy machine learning — the factuality, alignment, and robustness of large models in domains such as healthcare, where errors carry real cost.

I am currently most interested in:

  • Multimodal Large Language Models — grounding, factuality, and preference alignment across vision and language.
  • Agentic AI — reliable planning, tool use, and decision-making for LLM agents.
  • Continual Learning & Agent Learning — how agents keep improving from experience, including in decentralized and privacy-preserving settings.

Collaborations

I’ve had the privilege of working closely with many distinguished researchers, including Prof. Timothy Miller at Boston Children’s Hospital and Harvard Medical School, Prof. Manling Li at Northwestern University, Prof. Huaxiu Yao at UNC-Chapel Hill, and Prof. Kang Li at the West China Biomedical Big Data Center. Many thanks to anyone who guided or helped me.

News

Apr 2026 A new preprint is available online.
Jan 2026 One paper received the Best Paper Award at the AAAI 2026 TrustAgent Workshop and the Outstanding Paper Award at the AAAI 2026 PerFM Workshop.
May 2025 I received my Master of Science degree in Computer Science from Brown University.
May 2025 One paper was accepted by ICML 2025.
Jan 2025 One paper was accepted by ICLR 2025 and one paper was accepted by NAACL 2025.
Sep 2024 One paper was accepted by NeurIPS 2024 and one paper was accepted by EMNLP 2024.

Publications

  1. Preprint
    clsgen.png
    CLSGen: A Dual-Head Fine-Tuning Framework for Joint Probabilistic Classification and Verbalized Explanation
    WonJin Yoon*Kangyu Zhu*, Ian Bulovic, and 5 more authors
    Preprint, 2026
  2. AAAI’26 Workshop Best Paper Award
    federated_agent.png
    Is Decentralized LLM Agent RL Robust to Heterogeneity? An Asymmetric Tale
    Canyu Chen*Kangyu Zhu*, Zhaorun Chen, and 6 more authors
    In TrustAgent@AAAI 2026, Oral · PerFM@AAAI 2026, Oral, 2026
  3. ICML 2025
    mmedpo.png
    MMedPO: Aligning Medical Vision-Language Models with Clinical-Aware Multimodal Preference Optimization
    Kangyu Zhu*, Peng Xia*, Yun Li, and 3 more authors
    In Proceeding of the Forty-second International Conference on Machine Learning (ICML), 2025
  4. NAACL 2025
    medvp.png
    Guiding Medical Vision-Language Models with Explicit Visual Prompts: Framework Design and Comprehensive Exploration of Prompt Variations
    Kangyu Zhu*, Ziyuan Qin*, Huahui Yi, and 4 more authors
    In Proceedings of Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), 2025
  5. ICLR 2025
    mmed-rag.png
    MMed-RAG: Versatile Multimodal RAG System for Medical Vision Language Models
    Peng Xia, Kangyu Zhu, Haoran Li, and 6 more authors
    In Proceedings of International Conference on Learning Representations (ICLR), 2025
  6. EMNLP 2024
    rule.png
    RULE: Reliable Multimodal RAG for Factuality in Medical Vision Language Models
    Peng Xia*Kangyu Zhu*, Haoran Li, and 5 more authors
    In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024
  7. NeurIPS 2024
    cares.png
    CARES: A Comprehensive Benchmark of Trustworthiness in Medical Vision Language Models
    Peng Xia, Ze Chen, Juanxi Tian, and 8 more authors
    In Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2024

Awards

Press

Service

Conference Reviewer ICML, NeurIPS, ECCV, COLM

Education

M.S. 2023-2025
Brown University
Department of Computer Science
Brown University logo
B.S. 2019-2023 (double-degree)
University of Illinois Urbana-Champaign (UIUC)
Electrical Engineering with Honor.
University of Illinois Urbana-Champaign (UIUC) logo
B.E. 2019-2023 (double-degree)
Zhejiang University (ZJU)
Electrical Engineering and Automation, Outstanding Undergraduate Student.
Zhejiang University (ZJU) logo

Teaching

Course Role Institution / Term
ECE110: Introduction to Electronics Teaching Assistant ZJU-UIUC Institute, Fall 2022