Learning on Transformers is Provable Low-Rank and Sparse: A One-layer Analysis
- Hongkang Li
- Meng Wang
- et al.
- 2024
- SAM 2024
Publications
Date
Featured collections
Popular topics
13 results for Meng Wang
How Does Promoting the Minority Fraction Affect Generalization? A Theoretical Study of One-Hidden-Layer Neural Network on Group Imbalance
- Hongkang Li
- Shuai Zhang
- et al.
- 2024
- Ieee Journal Of Selected Topics In Signal Processing
Patch-level Routing in Mixture-of-Experts is Provably Sample-efficient for Convolutional Neural Networks
- Mohammed Nowaz Rabbani Chowdhury
- Shuai Zhang
- et al.
- 2023
- ICML 2023
Generalization Guarantee of Training Graph Convolutional Networks with Graph Topology Sampling
- Hongkang Li
- Meng Wang
- et al.
- 2022
- ICML 2022
Improved Linear Convergence of Training CNNs with Generalizability Guarantees: A One-Hidden-Layer Case
- Shuai Zhang
- Meng Wang
- et al.
- 2021
- IEEE TNNLS
On Fast Adversarial Robustness Adaptation in Model-Agnostic Meta-Learning
- Ren Wang
- Kaidi Xu
- et al.
- 2021
- ICLR 2021
Quantized Higher-Order Tensor Recovery by Exploring Low-Dimensional Structures
- Ren Wang
- Meng Wang
- et al.
- 2020
- ACSSC 2020
Tensor recovery from noisy and multi-level quantized measurements
- Ren Wang
- Meng Wang
- et al.
- 2020
- EURASIP J. Adv. Sign. Process.
Fast learning of graph neural networks with guaranteed generalizability: One-hidden-layer case
- Shuai Zhang
- Meng Wang
- et al.
- 2020
- ICML 2020
Achieve data privacy and clustering accuracy simultaneously through quantized data recovery
- Ren Wang
- Meng Wang
- et al.
- 2020
- EURASIP J. Adv. Sign. Process.