LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models

Yixiao Li*, Yifan Yu*, Chen Liang, Pengcheng He, Nikos Karampatziakis, Weizhu Chen, Tuo Zhao
October 2023
Arxiv Blog Github Ckpt
Type
Conference paper
Publication
ICLR, 2024