Less is More: Task-aware Layer-wise Distillation for Language Model Compression

Chen Liang, Simiao Zuo, Qingru Zhang, Pengcheng He, Weizhu Chen, Tuo Zhao
May 2023
Arxiv Github
Type
Conference paper
Publication
The 40th International Conference on Machine Learning (ICML), 2023