Queue Management for Large Language Model Serving
- Archit Patke
- Dhemath Reddy
- et al.
- 2024
- SoCC 2024
Publications
Date
Featured collections
Popular topics
6 results for Archit Patke
Power-aware Deep Learning Model Serving with μ-Serve
- Haoran Qiu
- Weichao Mao
- et al.
- 2024
- USENIX ATC 2024
Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction
- Haoran Qiu
- Weichao Mao
- et al.
- 2024
- ASPLOS 2024
Queue Management for Large Language Model Serving
- Archit Patke
- Dhemath Reddy
- et al.
- 2024
- ASPLOS 2024
Evaluating Hardware Memory Disaggregation under Delay and Contention
- Archit Patke
- Haoran Qiu
- et al.
- 2022
- IPDPS 2022
Is Function-as-a-Service a Good Fit for Latency-Critical Services?
- Haoran Qiu
- Saurabh Jha
- et al.
- 2021
- Middleware 2021