Queue Management for Large Language Model Serving
- Archit Patke
- Dhemath Reddy
- et al.
- 2024
- SoCC 2024
Publications
Date
Featured collections
Popular topics
14 results for Ravishankar K. Iyer
True Attacks, Attack Attempts, or Benign Triggers? An Empirical Measurement of Network Alerts in a Security Operations Center
- Limin Yang
- Zhi Chen
- et al.
- 2024
- USENIX Security 2024
Power-aware Deep Learning Model Serving with μ-Serve
- Haoran Qiu
- Weichao Mao
- et al.
- 2024
- USENIX ATC 2024
Multi-Agent Meta-Reinforcement Learning: Sharper Convergence Rates with Task Similarity
- Weichao Mao
- Haoran Qiu
- et al.
- 2023
- NeurIPS 2023
AWARE: Automate Workload Autoscaling with Reinforcement Learning in Production Cloud Systems
- Haoran Qiu
- Weichao Mao
- et al.
- 2023
- USENIX ATC 2023
On the Promise and Challenges of Foundation Models for Learning-based Cloud Systems Management
- Haoran Qiu
- Weichao Mao
- et al.
- 2023
- NeurIPS 2023
PALM: Adaptive Resource Allocation for Datacenter Power Capping
- Haoran Qiu
- Linghao Zhang
- et al.
- 2023
- NeurIPS 2023
Flash: Fast Model Adaptation in ML-Centric Cloud Platforms
- Haoran Qiu
- Weichao Mao
- et al.
- 2024
- MLSys 2024
iPrism: Characterize and Mitigate Risk by Quantifying Change in Escape Routes
- Shengkun Cui
- Saurabh Jha
- et al.
- 2023
- DSN 2023
When Green Computing Meets Performance and Resilience SLOs
- Haoran Qiu
- Weichao Mao
- et al.
- 2024
- DSN 2024