Xiangyu Li

Xiangyu Li

Ph.D. Candidate, AIR, Tsinghua University

I am a 5th year Ph.D. candidate at AIR, THU, working on on-device AI (Ph.D. work overview) and embodied AI. Currently I am exploring efficient deployment of embodied foundation models (VLAs and WAMs), as well as self-evolving physical intelligence.

News

See all

Selected Papers

See all

OxyGen: Unified KV Cache Management for VLA Inference under Multi-Task Parallelism

Xiangyu Li, Huaizhi Tang, Xin Ding, Weijun Wang, Ting Cao, Yunxin Liu

ArXiv preprint, 2026

Vec-LUT: Vector Table Lookup for Parallel Ultra-Low-Bit LLM Inference on Edge Devices

Xiangyu Li*, Chengyu Yin*, Weijun Wang, Jianyu Wei, Ting Cao, Yunxin Liu

ACM MobiSys 2026Best Paper Award Runner-Up, Results Reproduced @AE

FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge DevicesCitations: 75

Xiangyu Li, Yuanchun Li, Yuanzhe Li, Ting Cao, Yunxin Liu

ACM MobiCom 2024Results Replicated @AE

Personal LLM Agents: Insights and Survey about the Capability, Efficiency and SecurityCitations: 474

Yuanchun Li, Hao Wen, Weijun Wang, Xiangyu Li, Yizhen Yuan, Guohong Liu, Jiacheng Liu, Wenxing Xu, Xiang Wang, Yi Sun, Rui Kong, Yile Wang, Hanfei Geng, Jian Luan, Xuefeng Jin, Zilong Ye, Guanjing Xiong, Fan Zhang, Xiang Li, Mengwei Xu, Zhijun Li, Peng Li, Yang Liu, Ya-Qin Zhang, Yunxin Liu

ArXiv preprint, 2024Survey & Position, “Efficiency” Section Lead

Latest Posts

See all

A Unified KV Cache for Multi-Task Inference on Robots

OxyGen treats the KV cache as one shared resource across tasks and control frames, letting Mixture-of-Transformers VLAs keep full action frequency while generating language concurrently, up to 3.7× faster on an RTX 4090 and Jetson AGX Thor.

Deploying and Accelerating Cosmos 3 Robot Policy on RTX 4090s

How quantization, sampler tuning, kernel work, and rollout topology accelerate NVIDIA's 16B Cosmos 3 robot policies on 24 GB GPUs — from single-request serving to full 1,200-episode evaluations.

Making Low-Bit LLMs Actually Fast in Parallel via Vector Table Lookup

Vec-LUT turns repetitive scalar table lookups into contiguous vector reads, accelerating parallel ternary LLM inference on x86 and ARM CPUs by up to 4.2×.