LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation

Yixiao Li*, Yifan Yu*, Qingru Zhang, Chen Liang, Pengcheng He, Weizhu Chen, Tuo Zhao
June 2023
Arxiv Github
Type
Conference paper
Publication
The 40th International Conference on Machine Learning (ICML), 2023