Robustness to Unbounded Smoothness of Generalized SignSGD
- Michael Crawshaw
- Mingrui Liu
- et al.
- 2022
- NeurIPS 2022
Publications
Date
Featured collections
Popular topics
42 results for Wei Zhang
Hybrid 8-bit floating point (HFP8) training and inference for deep neural networks
- Xiao Sun
- Jungwook Choi
- et al.
- 2019
- NeurIPS 2019
Evolutionary stochastic gradient descent for optimization of deep neural networks
- Xiaodong Cui
- Wei Zhang
- et al.
- 2018
- NeurIPS 2018
Asynchronous decentralized parallel stochastic gradient descent
- Xiangru Lian
- Wei Zhang
- et al.
- 2018
- ICML 2018
ADaComP: Adaptive residual gradient compression for data-parallel distributed training
- Chia-Yu Chen
- Jungwook Choi
- et al.
- 2018
- AAAI 2018
Can decentralized algorithms outperform centralized algorithms? A case study for decentralized parallel stochastic gradient descent
- Xiangru Lian
- Ce Zhang
- et al.
- 2017
- NeurIPS 2017
Nexus: Bringing Efficient and Scalable Training to Deep Learning Frameworks
- Yandong Wang
- Li Zhang
- et al.
- 2017
- MASCOTS 2017
INVITED: Accelerator Design for Deep Learning Training: Extended Abstract: Invited
- Ankur Agrawal
- Chia-Yu Chen
- et al.
- 2017
- DAC 2017
Activity–weight duality in feed-forward neural networks reveals two co-determinants for generalization
- Yu Feng
- Wei Zhang
- et al.
- 2023
- Nature Machine Intelligence
4-bit quantization of LSTM-based speech recognition models
- Andrea Fasoli
- Chia-Yu Chen
- et al.
- 2021
- INTERSPEECH 2021