Optimizing GPU Multiplexing for Efficient and Cost-Effective Access to Diverse Large Language Models in GPU Clusters
- Yue Zhu
- Chen Wang
- et al.
- 2024
- MASCOTS 2024
Publications
Date
Featured collections
Popular topics
9 results for Eun Kyung Lee
Process-based Efficient Power Level Exporter
- Marcelo Amaral
- Huamin Chen
- et al.
- 2024
- CLOUD 2024
HAL: Hardware-assisted Load Balancing for Energy-efficient SNIC-Host Cooperative Computing
- Jinghan Huang
- Jiaqi Lou
- et al.
- 2024
- ISCA 2024
Best-Effort Power Model Serving for Energy Quantification of Cloud Instances
- 2024
- MASCOTS 2024
Advancing Cloud Sustainability: A Versatile Framework for Container Power Model Training
- 2023
- MASCOTS 2023
STRonG: System Topology Risk Analysis on Graphs
- Lars Schneidenbach
- Sandhya Koteshwara
- et al.
- 2024
- CCGrid 2024
Towards Pareto Optimal Throughput in Small Language Model Serving
- Pol G. Recasens
- Yue Zhu
- et al.
- 2024
- EuroSys 2024
Towards a Methodology and Framework for AI Sustainability Metrics
- Tamar Eilam
- Pedro Bello-Maldonado
- et al.
- 2023
- HotCarbon 2023
Cloud Native Sustainable LLM Inference in Action
- Chen Wang
- Eun Kyung Lee
- et al.
- 2024
- KubeCon EU 2024