Haoyun Deng

large language models

inference optimization

efficient serving

speculative decoding

prefill–decoding disaggregation

prefix cache

kv cache

quantization

pruning

model compression

low-bit inference

scheduling

memory optimization

distributed inference systems

inference frameworks

Triton

TensorRT-LLM

vLLM

serving infrastructure