leloykun / modded-nanogptLinks
NanoGPT (124M) quality in 2.67B tokens
☆28Updated 2 weeks ago
Alternatives and similar repositories for modded-nanogpt
Users that are interested in modded-nanogpt are comparing it to the libraries listed below
Sorting:
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 6 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆105Updated 5 months ago
- NanoGPT-speedrunning for the poor T4 enjoyers