facebookresearch / midtraining-distillationView on GitHub
Code for our paper: "Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall"
☆14Oct 10, 2026Updated 2 weeks ago

Alternatives and similar repositories for midtraining-distillation

Users that are interested in midtraining-distillation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?