Research
•
December 15, 2025
Distilling Kimi Delta Attention into AFM-4.5B (and the Tool We Used to Do It)
Learn how Kimi Delta Attention was distilled into AFM-4.5B using knowledge distillation, long-context training, and Arcee’s open-source DistillKit.












.png)

.png)