Y0oshi / Text-LLM-Training-from-scratchView on GitHub
A from-scratch implementation of the language-model training pipeline in PyTorch: tokenization, pretraining, SFT, and preference-based alignment.
18Jul 13, 2026Updated this week

Alternatives and similar repositories for Text-LLM-Training-from-scratch

Users that are interested in Text-LLM-Training-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?