srush / Tensor-Puzzles

Related projects ⓘ

Alternatives and complementary repositories for Tensor-Puzzles

• srush / GPU-Puzzles
  Solve puzzles. Learn CUDA.
  ☆9,851Updated 2 months ago
• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆892Updated 9 months ago
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,060Updated last month
• gpu-mode / resource-stream
  GPU programming related news and material links
  ☆1,205Updated last month
• google-deepmind / penzai
  A JAX research toolkit for building, editing, and visualizing neural networks.
  ☆1,673Updated last week
• gpu-mode / lectures
  Material for gpu-mode lectures
  ☆2,962Updated this week
• pytorch-labs / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆5,647Updated 3 weeks ago
• karpathy / makemore
  An autoregressive character-level language model for making more things
  ☆2,582Updated 5 months ago
• srush / Autodiff-Puzzles
  ☆386Updated 3 weeks ago
• facebookresearch / schedule_free
  Schedule-Free Optimization in PyTorch
  ☆1,864Updated this week
• xl0 / lovely-tensors
  Tensors, for human consumption
  ☆1,111Updated last week
• minitorch / minitorch
  The full minitorch student suite.
  ☆1,910Updated 2 months ago
• pytorch / torchtitan
  A native PyTorch Library for large model training
  ☆2,566Updated this week
• stas00 / ml-engineering
  Machine Learning Engineering Open Book
  ☆11,589Updated this week
• KellerJordan / modded-nanogpt
  NanoGPT (124M) quality in 8.2 minutes
  ☆911Updated this week
• jacobhilton / deep_learning_curriculum
  Language model alignment-focused deep learning curriculum
  ☆1,263Updated 2 months ago
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆1,629Updated this week
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆321Updated last year
• clu0 / unet.cu
  UNet diffusion model in pure CUDA
  ☆567Updated 4 months ago
• karpathy / nano-llama31
  nanoGPT style version of Llama 3.1
  ☆1,229Updated 3 months ago
• karpathy / micrograd
  A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API
  ☆10,434Updated 3 months ago
• naklecha / llama3-from-scratch
  llama3 implementation one matrix multiplication at a time
  ☆13,673Updated 5 months ago
• JonasGeiping / cramming
  Cramming the training of a (BERT-type) language model into limited compute.
  ☆1,294Updated 4 months ago
• Lightning-AI / lightning-thunder
  Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors a…
  ☆1,187Updated this week
• karpathy / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆3,573Updated 2 months ago
• adam-maj / tiny-gpu
  A minimal GPU design in Verilog to learn how GPUs work from the ground up
  ☆7,066Updated 2 months ago
• karpathy / cryptos
  Pure Python from-scratch zero-dependency implementation of Bitcoin for educational purposes
  ☆1,606Updated 3 years ago
• evanmiller / LLM-Reading-List
  LLM papers I'm reading, mostly on inference and model compression
  ☆692Updated 10 months ago
• johnma2006 / mamba-minimal
  Simple, minimal implementation of the Mamba SSM in one file of PyTorch.
  ☆2,614Updated 8 months ago
• veekaybee / what_are_embeddings
  A deep dive into embeddings starting from fundamentals
  ☆953Updated 6 months ago