Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction
- Haoran Qiu
- Weichao Mao
- et al.
- 2024
- ASPLOS 2024
Publications
Date
Featured collections
Popular topics
14 results for Ravishankar K. Iyer
Queue Management for Large Language Model Serving
- Archit Patke
- Dhemath Reddy
- et al.
- 2024
- ASPLOS 2024
Evaluating Hardware Memory Disaggregation under Delay and Contention
- Archit Patke
- Haoran Qiu
- et al.
- 2022
- IPDPS 2022
Is Function-as-a-Service a Good Fit for Latency-Critical Services?
- Haoran Qiu
- Saurabh Jha
- et al.
- 2021
- Middleware 2021