JoeLi12345 / nGPT
an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
☆91Updated 3 weeks ago
Alternatives and similar repositories for nGPT:
Users that are interested in nGPT are comparing it to the libraries listed below
- model activation visualiser☆90Updated this week
- look how they massacred my boy☆63Updated 5 months ago
- Collection of autoregressive model implementation☆83Updated last month
- Lego for GRPO☆25Updated 2 weeks ago
- ☆27Updated 8 months ago
- Simple GRPO scripts and configurations.☆59Updated last month
- Train your own SOTA deductive reasoning model☆81Updated 3 weeks ago
- smolLM with Entropix sampler on pytorch