A Comparative Analysis of Task-Agnostic Distillation Methods for Compressing Transformer Language Models
- Takuma Udagawa
- Aashka Trivedi
- et al.
- 2023
- EMNLP 2023
Publications
Date
Featured collections
Popular topics
- Foundation Models
614 results for Foundation Models
Where to start? Analyzing the potential value of intermediate models
- Leshem Choshen
- Elad Venezian
- et al.
- 2023
- EMNLP 2023
Knowledge is a Region in Weight Space for Finetuned Language Models
- Almog Gueta
- Elad Venezian
- et al.
- 2023
- EMNLP 2023
NLFOA: Natural Language Focused Ontology Alignment
- Florian Schneider
- Sarthak Dash
- et al.
- 2023
- K-CAP 2023
TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecasting
- Vijay Ekambaram
- Arindam Jati
- et al.
- 2023
- KDD 2023
CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learning
- James Seale Smith
- Leonid Karlinsky
- et al.
- 2023
- CVPR 2023
Teaching Structured Vision & Language Concepts to Vision & Language Models
- Sivan Doveh
- Assaf Arbelle
- et al.
- 2023
- CVPR 2023
Visual Prompting for Adversarial Robustness
- Aochuan Chen
- Peter Lorenz
- et al.
- 2023
- ICASSP 2023
Convex Bounds on the Softmax Function with Applications to Robustness Verification
- Dennis Wei
- Haoze Wu
- et al.
- 2023
- AISTATS 2023
Reprogrammable-FL: Improving Utility-Privacy Tradeoff in Federated Learning via Model Reprogramming
- Huzaifa Arif
- Alex Gittens
- et al.
- 2023
- IEEE SaTML 2023