• Cloud Computing
• Machine Learning Systems
• Currently working onLLM Serving Systems.

• ICSE-SEIP'23
• Eurosys'24
• ASPLOS'24
• RagInfer (OSDI'25 submission)
• AgentServing (OSDI'25 submission, co-first author)

• Aceso: Auto Parallel DNN Training
• Raginfer: low latency RAG inference system
• Autellix: high throuhput LLM agent serving system
• DeepScaler: RL LLM training

📫 Feel free to email me atlambda7xx@gmail.com if you are interested in my work.

PinnedLoading

1. chinese-poetrychinese-poetryPublic

   Forked fromLC-John/chinese-poetry

   最全中华古诗词数据库, 唐宋两朝近一万四千古诗人, 接近5.5万首唐诗加26万宋诗. 两宋时期1564位词人，21050首词。

   Python

2. awesome-AI-systemawesome-AI-systemPublic

   paper and its code for AI System

   283 21

3. vllm-project/vllmvllm-project/vllmPublic

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 42.6k 6.5k

4. deepscalerdeepscalerPublic

   Forked fromagentica-project/deepscaler

   Democratizing Reinforcement Learning for LLMs

   Python

5. sgl-project/sglangsgl-project/sglangPublic

   SGLang is a fast serving framework for large language models and vision language models.

   Python 12.4k 1.3k

6. TensorRT-LLMTensorRT-LLMPublic

   Forked fromNVIDIA/TensorRT-LLM

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++