KellerJordan / modded-nanogpt
NanoGPT (124M) in 3 minutes
☆2,403Updated this week
Alternatives and similar repositories for modded-nanogpt:
Users that are interested in modded-nanogpt are comparing it to the libraries listed below
- A PyTorch native library for large model training☆3,470Updated this week
- nanoGPT style version of Llama 3.1☆1,341Updated 7 months ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆948Updated 2 weeks ago
- PyTorch native quantization and sparsity for training and inference☆1,913Updated this week
- Schedule-Free Optimization in PyTorch☆2,116Updated 3 weeks ago
- PyTorch native post-training library☆5,014Updated this week
- Code for BLT research paper☆1,436Updated this week
- Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.☆4,481Updated last month
- Official repository for our work on micro-budget training of large-scale diffusion models.☆1,356Updated 2 months ago
- Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"☆855Updated last month
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆5,892Updated last week
- Minimalistic large language model 3D-parallelism training☆1,701Updated this week
- Run PyTorch LLMs locally on servers, desktop and mobile☆3,530Updated this week
- Large Concept Models: Language modeling in a sentence representation space☆2,053Updated last month
- AllenAI's post-training codebase☆2,827Updated this week
- A JAX research toolkit for building, editing, and visualizing neural networks.☆1,746Updated 3 months ago
- Everything about the SmolLM2 and SmolVLM family of models☆2,035Updated last week
- Efficient Triton Kernels for LLM Training☆4,683Updated this week
- DataComp for Language Models☆1,263Updated this week
- System 2 Reasoning Link Collection☆811Updated last week
- The n-gram Language Model☆1,402Updated 7 months ago
- Implementation for MatMul-free LM.☆2,969Updated 4 months ago
- Tools for merging pretrained large language models.☆5,458Updated this week
- Puzzles for learning Triton☆1,527Updated 4 months ago
- Tile primitives for speedy kernels☆2,170Updated this week
- verl: Volcano Engine Reinforcement Learning for LLMs☆5,399Updated this week
- UNet diffusion model in pure CUDA☆600Updated 8 months ago
- Recipes to scale inference-time compute of open models☆1,041Updated 3 weeks ago
- Training Large Language Model to Reason in a Continuous Latent Space☆985Updated last month
- Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜☆1,316Updated last week