Shuffle the Context: RoPE-Perturbed Self-Distillation for Long-Context Adaptation

Zichong Li, Chen Liang, Liliang Ren, Tuo Zhao, Yelong Shen, Weizhu Chen
April 2026
Arxiv
Type
Preprint
Publication
The 43th International Conference on Machine Learning (ICML), 2026