Transfer Learning

Pre-Trained Models

Continual Pre-Training

Spectrum

Signal-to-Noise Ratio

Spectrum-Powered Pre-training

Fine-Tuning

Fine-Tuned Models

MergeKit

Model Merging

Evolutionary Model Merging

RAG(Retrieval-Augmented Generation)

RAG Pros and Cons

Knowledge Distillation