About Me

Hey all! I am an incoming PhD student at UCB Sky Lab. My research interest lies around providing system support for emerging applications like machine learning and multimedia. I graduated from University of Chicago with BS in Math and CS (both honors), mainly working with Prof. Junchen Jiang.

I am currently working on LLM serving, including LMCache and vLLM Production Stack. Let me know if you are interested in learning more about serving open-source LLM efficiently or contributing!

My previous research included video conferencing, and I was one of the very first people to optimize KV cache reuse for LLMs.

Selected Publications

* indicates equivalent contribution

• CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion
  Jiayi Yao, Hanchen Li, Yuhan Liu, Siddhant Ray, Yihua Cheng, Qizheng Zhang, Kuntai Du, Shan Lu, Junchen Jiang
  EuroSys 2025 (Best Paper Award!) [Paper]

• CacheGen: Fast Context Loading for Language Model Applications
  Yuhan Liu, Hanchen Li, Kuntai Du, Jiayi Yao, Yihua Cheng, Yuyang Huang, Shan Lu, Michael Maire, Henry Hoffmann, Ari Holtzman, Ganesh Ananthanarayanan, Junchen Jiang
  SIGCOMM 2024 [Paper] [Talk] [Slides]

• Eloquent: More Robust Transmission Scheme for LLM Token Streaming
  Hanchen Li, Yuhan Liu, Yihua Cheng, Siddhant Ray, Kuntai Du, Junchen Jiang
  SIGCOMM 2024 Workshop on Networks for AI Computing (NAIC) [Paper]

• GRACE: Loss-Resilient Real-Time Video Communication Using Data-Scalable Autoencoder
  Yihua Cheng, Ziyi Zhang, Hanchen Li, Anton Arapin, Yue Zhang, Qizheng Zhang, Yuhan Liu, Xu Zhang, Francis Y. Yan, Amrita Mazumdar, Nick Feamster, Junchen Jiang
  NSDI 2024 [Paper]

• Optimizing Real-Time Video Experience with Data Scalable Codec
  Hanchen Li*, Yihua Cheng*, Ziyi Zhang, Qizheng Zhang, Anton Arapin, Nick Feamster, Amrita Mazumdar
  SIGCOMM 2023 Workshop on Emerging Multimedia Systems (EMS) [Paper]

All Publications (check Google Scholar)

Life

• My name in Chinese is 李翰宸 and I grew up in Nanjing, Jiangsu.
• I play soccer, basketball, and weightlift. I also enjoy 掼蛋(Guan Dan, a popular card game in JiangsuChina) with friends.