KellerJordan / modded-nanogpt

Related projects ⓘ

Alternatives and complementary repositories for modded-nanogpt

• karpathy / nano-llama31
  nanoGPT style version of Llama 3.1
  ☆1,246Updated 3 months ago
• clu0 / unet.cu
  UNet diffusion model in pure CUDA
  ☆584Updated 4 months ago
• EurekaLabsAI / mlp
  The Multilayer Perceptron Language Model
  ☆523Updated 3 months ago
• microsoft / Samba
  Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"
  ☆803Updated 3 months ago
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆715Updated last month
• EurekaLabsAI / micrograd
  The Autograd Engine
  ☆534Updated 2 months ago
• pytorch / torchtitan
  A native PyTorch Library for large model training
  ☆2,623Updated this week
• open-thought / system-2-research
  System 2 Reasoning Link Collection
  ☆693Updated 3 weeks ago
• EurekaLabsAI / tensor
  The Tensor (or Array)
  ☆411Updated 3 months ago
• google-deepmind / penzai
  A JAX research toolkit for building, editing, and visualizing neural networks.
  ☆1,679Updated this week
• facebookresearch / schedule_free
  Schedule-Free Optimization in PyTorch
  ☆1,898Updated 2 weeks ago
• google-deepmind / recurrentgemma
  Open weights language model from Google DeepMind, based on Griffin.
  ☆607Updated 4 months ago
• EurekaLabsAI / ngram
  The n-gram Language Model
  ☆1,342Updated 3 months ago
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,135Updated this week
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,260Updated this week
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆1,658Updated this week
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆286Updated 2 weeks ago
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆483Updated 3 weeks ago
• kvfrans / jax-diffusion-transformer
  Implementation of Diffusion Transformer (DiT) in JAX
  ☆252Updated 5 months ago
• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆903Updated 10 months ago
• gautierdag / bpeasy
  Fast bare-bones BPE for modern tokenizer training
  ☆142Updated last month
• ironjr / grokfast
  Official repository for the paper "Grokfast: Accelerated Grokking by Amplifying Slow Gradients"
  ☆515Updated 4 months ago
• Lightning-AI / lightning-thunder
  Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors a…
  ☆1,199Updated this week
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆457Updated 8 months ago
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆449Updated this week
• stanfordnlp / pyreft
  ReFT: Representation Finetuning for Language Models
  ☆1,159Updated 2 weeks ago
• srush / awesome-o1
  A bibliography and survey of the papers surrounding o1
  ☆754Updated this week
• trotsky1997 / MathBlackBox
  ☆935Updated 2 weeks ago
• carlini / yet-another-applied-llm-benchmark
  A benchmark to evaluate language models on questions I've previously asked them to solve.
  ☆916Updated 2 weeks ago
• merveenoyan / smol-vision
  Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜
  ☆890Updated 2 months ago