Alternatives and similar repositories for beyond-nanogpt:

Users that are interested in beyond-nanogpt are comparing it to the libraries listed below

• natolambert / rlhf-book
  Textbook on reinforcement learning from human feedback
  ☆795Updated this week
• McGill-NLP / nano-aha-moment
  Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
  ☆385Updated 2 weeks ago
• groundlight / r1_vlm
  Build your own visual reasoning model
  ☆341Updated this week
• brendanhogan / DeepSeekRL-Extended
  Exploring Applications of GRPO
  ☆185Updated last week
• EurekaLabsAI / mlp
  The Multilayer Perceptron Language Model
  ☆543Updated 8 months ago
• Laz4rz / GPT-2
  Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish
  ☆174Updated 8 months ago
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆337Updated last month
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆131Updated last month
• EurekaLabsAI / micrograd
  The Autograd Engine
  ☆597Updated 7 months ago
• Alx-AI / AI_Diplomacy
  ☆218Updated this week
• open-thought / system-2-research
  System 2 Reasoning Link Collection
  ☆826Updated last month
• EurekaLabsAI / tensor
  The Tensor (or Array)
  ☆429Updated 8 months ago
• menloresearch / visual-thinker
  ☆144Updated last month
• yuanchenyang / smalldiffusion
  Simple and readable code for training and sampling from diffusion models
  ☆478Updated 3 months ago
• neubig / starter-repo
  An example starter repo for Python projects
  ☆279Updated last month
• open-thought / reasoning-gym
  procedural reasoning datasets
  ☆571Updated this week
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆240Updated last week
• kevinpdev / gpt-from-scratch
  Educational implementation of a small GPT model from scratch in a single Jupyter Notebook
  ☆91Updated 2 months ago
• allenai / OLMo-core
  PyTorch building blocks for the OLMo ecosystem
  ☆197Updated this week
• willkurt / token-explorer
  A simple tool that let's you explore different possible paths that an LLM might sample.
  ☆163Updated 2 weeks ago
• KindXiaoming / grow-crystals
  Getting crystal-like representations with harmonic loss
  ☆182Updated 3 weeks ago
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆786Updated last month
• PaulPauls / llama3_interpretability_sae
  A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…
  ☆607Updated last month
• huggingface / picotron
  Minimalistic 4D-parallelism distributed training framework for education purpose
  ☆991Updated last month
• gpu-mode / awesomeMLSys
  An ML Systems Onboarding list
  ☆756Updated 3 months ago
• allenai / codescientist
  CodeScientist: An automated scientific discovery system for code-based experiments
  ☆221Updated 3 weeks ago
• ekinakyurek / marc
  Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"
  ☆304Updated 5 months ago
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆304Updated 6 months ago
• willccbb / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆827Updated 3 weeks ago
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,058Updated 2 months ago