Personal information

Activities

Collapse all

Works (3)

CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving

2024-08-04 | Conference paper
DOI: 10.1145/3651890.3672274
Contributors: Yuhan Liu; Hanchen Li; Yihua Cheng; Siddhant Ray; Yuyang Huang; Qizheng Zhang; Kuntai Du; Jiayi Yao; Shan Lu; Ganesh Ananthanarayanan et al.
Source: check_circle
Crossref

Eloquent: A More Robust Transmission Scheme for LLM Token Streaming

2024-08-04 | Conference paper
DOI: 10.1145/3672198.3673797
Contributors: Hanchen Li; Yuhan Liu; Yihua Cheng; Siddhant Ray; Kuntai Du; Junchen Jiang
Source: check_circle
Crossref

Optimizing Real-Time Video Experience with Data Scalable Codec

2023-09-10 | Conference paper
DOI: 10.1145/3609395.3611108
Contributors: Hanchen Li; Yihua Cheng; Ziyi Zhang; Qizheng Zhang; Anton Arapin; Nick Feamster; Amrita Mazumdar
Source: check_circle
Crossref
How many people are using ORCID?