HomoDistil: Homotopic Task-Agnostic Distillation of Pre-trained Transformers

Chen Liang, Haoming Jiang, Zheng Li, Xianfeng Tang, Bing Yin, Tuo Zhao
January 2023
Arxiv
Type
Conference paper
Publication
The 11th International Conference on Learning Representations (ICLR), 2023