gpu-mode / awesomeMLSys

Related projects ⓘ

Alternatives and complementary repositories for awesomeMLSys

• gpu-mode / resource-stream
  GPU programming related news and material links
  ☆1,242Updated last month
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,138Updated this week
• mlops-discord / gpu-optimization-workshop
  Slides, notes, and materials for the workshop
  ☆306Updated 5 months ago
• clu0 / unet.cu
  UNet diffusion model in pure CUDA
  ☆584Updated 4 months ago
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆717Updated last month
• HazyResearch / aisys-building-blocks
  Building blocks for foundation models.
  ☆397Updated 10 months ago
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆483Updated 3 weeks ago
• arpitingle / gpu-alpha
  High Quality Resources on GPU Programming/Architecture
  ☆566Updated 3 months ago
• EurekaLabsAI / tensor
  The Tensor (or Array)
  ☆411Updated 3 months ago
• ulrichstern / cuda-convnet
  Alex Krizhevsky's original code from Google Code
  ☆190Updated 8 years ago
• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆910Updated 10 months ago
• KellerJordan / modded-nanogpt
  NanoGPT (124M) in 5 minutes
  ☆1,269Updated this week
• evanmiller / LLM-Reading-List
  LLM papers I'm reading, mostly on inference and model compression
  ☆694Updated 11 months ago
• linjames0 / Transformer-CUDA
  An implementation of the transformer architecture onto an Nvidia CUDA kernel
  ☆157Updated last year
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆288Updated this week
• EurekaLabsAI / mlp
  The Multilayer Perceptron Language Model
  ☆523Updated 3 months ago
• EurekaLabsAI / micrograd
  The Autograd Engine
  ☆535Updated 2 months ago
• Infatoshi / cuda-course
  ☆563Updated 3 weeks ago
• gpu-mode / lectures
  Material for gpu-mode lectures
  ☆3,028Updated this week
• gpu-mode / profiling-cuda-in-torch
  ☆133Updated 9 months ago
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆1,661Updated this week
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆107Updated last year
• 0xD4rky / Vision-Transformers
  This repo has all the basic things you'll need in-order to understand complete vision transformer architecture and its various implementa…
  ☆170Updated last month
• Laz4rz / GPT-2
  Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish
  ☆167Updated 3 months ago
• srush / awesome-o1
  A bibliography and survey of the papers surrounding o1
  ☆780Updated last week
• tspeterkim / flash-attention-minimal
  Flash Attention in ~100 lines of CUDA (forward pass only)
  ☆626Updated 7 months ago
• smolorg / smolgrad
  small auto-grad engine inspired from Karpathy's micrograd and PyTorch
  ☆175Updated this week
• srush / Autodiff-Puzzles
  ☆391Updated last month
• open-thought / system-2-research
  System 2 Reasoning Link Collection
  ☆694Updated 3 weeks ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆153Updated this week