Photo of Yu Zhao

Yu Zhao

PhD Student · School of Informatics, University of Edinburgh

I am a PhD student at the University of Edinburgh and a member of EdinburghNLP, supervised by Pasquale Minervini, Mirella Lapata, and Fazl Barez.

My research focuses on large language models: how pre-training data shapes them, how they use knowledge and long contexts, and how to make them more efficient and controllable. I am currently working on efficient and faithful vision-language model agents, and on building interpretability agents that automatically discover the mechanisms of LLMs.

2026 News

Industry Experience

Publications

* equal contribution. Citation counts from Google Scholar.

  1. 2026
  2. ICML
    Learning GUI Grounding with Spatial Reasoning from Visual Feedback
    Yu Zhao, Wei-Ning Chen, Huseyin A. Inan, Samuel Kessler, Lu Wang, Lukas Wutschitz, Fangkai Yang, Chaoyun Zhang, Pasquale Minervini, Saravan Rajmohan, Robert Sim
    ICML 2026 · arXiv · PDF Cited by12
  3. ICML
    Can I Have Your Order? Monte-Carlo Tree Search for Slot Filling Ordering in Diffusion Language Models
    Joshua Ong Jun Leang, Yu Zhao, Mihaela Cătălina Stoian, Wenda Li, Shay B. Cohen, Eleonora Giunchiglia
    ICML 2026 · arXiv · PDF
  4. ICML
    Fast and Expressive Multi-Byte Prediction with Probabilistic Circuits
    Andreas Grivas, Lorenzo Loconte, Emile van Krieken, Piotr Nawrot, Yu Zhao, Euan Wielewski, Pasquale Minervini, Edoardo M. Ponti, Antonio Vergari
    ICML 2026 · arXiv · PDF Cited by6
  5. EMNLP
    Can Retrieval Heads See Images? Multimodal Retrieval Heads in Long-Context Vision-Language Models
    Aaron Branson Cigres Li, Zhaowei Wang, Yu Zhao, Yiming Du, Haobo Li, Xiyu Ren, Ginny Wong, Simon See, Lishu Luo, Haodong Duan, Pasquale Minervini, Yangqiu Song
    EMNLP 2026 · arXiv · PDF Cited by2
  6. 2025
  7. NAACL
    Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
    Yu Zhao, Alessio Devoto, Giwon Hong, Xiaotang Du, Aryo Pradipta Gema, Hongru Wang, Xuanli He, Kam-Fai Wong, Pasquale Minervini
    NAACL 2025 Oral · arXiv · PDF Cited by106
  8. NeurIPS
    MMLongBench: Benchmarking Long-Context Vision-Language Models Effectively and Thoroughly
    Zhaowei Wang, Wenhao Yu, Xiyu Ren, Jipeng Zhang, Yu Zhao, Rohit Saxena, Liang Cheng, Ginny Wong, Simon See, Pasquale Minervini, Yangqiu Song, Mark Steedman
    NeurIPS 2025 Spotlight · arXiv · PDF Cited by40
  9. NAACL
    Are We Done with MMLU?
    Aryo Pradipta Gema, Joshua Ong Jun Leang, Giwon Hong, Alessio Devoto, Alberto Carlo Maria Mancino, Rohit Saxena, Xuanli He, Yu Zhao, Xiaotang Du, Mohammad Reza Ghasemi Madani, Claire Barale, Robert McHardy, Joshua Harris, Jean Kaddour, Emile van Krieken, Pasquale Minervini
    NAACL 2025 · arXiv · PDF Cited by327
  10. AAAI
    Structured Packing in LLM Training Improves Long Context Utilization
    Konrad Staniszewski, Szymon Tworkowski, Sebastian Jaszczur, Yu Zhao, Henryk Michalewski, Łukasz Kuciński, Piotr Miłoś
    AAAI 2025 Oral · arXiv · PDF Cited by22
  11. COLM
    Noiser: Bounded Input Perturbations for Attributing Large Language Models
    Mohammad Reza Ghasemi Madani, Aryo Pradipta Gema, Gabriele Sarti, Yu Zhao, Pasquale Minervini, Andrea Passerini
    COLM 2025 · arXiv · PDF Cited by3
  12. Workshop
    Q-Filters: Leveraging QK Geometry for Efficient KV Cache Compression
    Nathan Godey, Alessio Devoto, Yu Zhao, Simone Scardapane, Pasquale Minervini, Éric de la Clergerie, Benoît Sagot
    Sparsity in LLMs Workshop @ ICLR 2025 · arXiv · PDF Cited by8
  13. 2024
  14. ACL
    Analysing the Impact of Sequence Composition on Language Model Pre-Training
    Yu Zhao, Yuanbin Qu, Konrad Staniszewski, Szymon Tworkowski, Wei Liu, Piotr Miłoś, Yuxiang Wu, Pasquale Minervini
    ACL 2024 Oral · arXiv · PDF Cited by38
  15. EMNLP
    A Simple and Effective L2 Norm-Based Strategy for KV Cache Compression
    Alessio Devoto*, Yu Zhao*, Simone Scardapane, Pasquale Minervini
    EMNLP 2024 Oral · arXiv · PDF Cited by102
  16. arXiv
    The Hallucinations Leaderboard: An Open Effort to Measure Hallucinations in Large Language Models
    Giwon Hong, Aryo Pradipta Gema, Rohit Saxena, Xiaotang Du, Ping Nie, Yu Zhao, Laura Perez-Beltrachini, Max Ryabinin, Xuanli He, Clémentine Fourrier, Pasquale Minervini
    arXiv preprint 2024 · arXiv · PDF Cited by64
  17. 2022 and earlier
  18. EMNLP
    An Efficient Memory-Augmented Transformer for Knowledge-Intensive NLP Tasks
    Yuxiang Wu, Yu Zhao, Baotian Hu, Pasquale Minervini, Pontus Stenetorp, Sebastian Riedel
    EMNLP 2022 Best Poster Award, NeurIPS ENLSP Workshop · arXiv · PDF Cited by94
  19. KDD
    Medical Dialogue Response Generation with Pivotal Information Recalling
    Yu Zhao, Yunxin Li, Yuxiang Wu, Baotian Hu, Qingcai Chen, Xiaolong Wang, Yuxin Ding, Min Zhang
    KDD 2022 · arXiv · DOI Cited by28
  20. NLPCC
    MSDF: A General Open-Domain Multi-Skill Dialog Framework
    Yu Zhao, Xinshuo Hu, Yunxin Li, Baotian Hu, Dongfang Li, Sichao Chen, Xiaolong Wang
    NLPCC 2021 · arXiv · PDF