gpu-mode / awesomeMLSys

Related projects ⓘ

Alternatives and complementary repositories for awesomeMLSys

• gpu-mode / resource-stream
  GPU programming related news and material links
  ☆1,208Updated last month
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,089Updated last month
• clu0 / unet.cu
  UNet diffusion model in pure CUDA
  ☆567Updated 4 months ago
• mlops-discord / gpu-optimization-workshop
  Slides, notes, and materials for the workshop
  ☆305Updated 5 months ago
• arpitingle / gpu-alpha
  High Quality Resources on GPU Programming/Architecture
  ☆563Updated 3 months ago
• HazyResearch / aisys-building-blocks
  Building blocks for foundation models.
  ☆388Updated 10 months ago
• EurekaLabsAI / tensor
  The Tensor (or Array)
  ☆408Updated 3 months ago
• EurekaLabsAI / mlp
  The Multilayer Perceptron Language Model
  ☆521Updated 3 months ago
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆711Updated last month
• ulrichstern / cuda-convnet
  Alex Krizhevsky's original code from Google Code
  ☆188Updated 8 years ago
• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆895Updated 10 months ago
• EurekaLabsAI / micrograd
  The Autograd Engine
  ☆530Updated 2 months ago
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆479Updated 2 weeks ago
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆1,643Updated this week
• srush / Autodiff-Puzzles
  ☆388Updated 3 weeks ago
• tspeterkim / flash-attention-minimal
  Flash Attention in ~100 lines of CUDA (forward pass only)
  ☆615Updated 7 months ago
• karpathy / nano-llama31
  nanoGPT style version of Llama 3.1
  ☆1,231Updated 3 months ago
• KellerJordan / modded-nanogpt
  NanoGPT (124M) quality in 7.8 8xH100-minutes
  ☆965Updated this week
• Laz4rz / GPT-2
  Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish
  ☆167Updated 3 months ago
• srush / awesome-o1
  A bibliography and survey of the papers surrounding o1
  ☆643Updated this week
• evanmiller / LLM-Reading-List
  LLM papers I'm reading, mostly on inference and model compression
  ☆691Updated 10 months ago
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆279Updated last week
• Infatoshi / cuda-course
  ☆515Updated 2 weeks ago
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆323Updated last year
• gpu-mode / lectures
  Material for gpu-mode lectures
  ☆2,967Updated this week
• Lightning-AI / lightning-thunder
  Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors a…
  ☆1,190Updated this week
• linjames0 / Transformer-CUDA
  An implementation of the transformer architecture onto an Nvidia CUDA kernel
  ☆157Updated last year
• 0xD4rky / Vision-Transformers
  This repo has all the basic things you'll need in-order to understand complete vision transformer architecture and its various implementa…
  ☆169Updated last month
• gpu-mode / profiling-cuda-in-torch
  ☆133Updated 9 months ago
• mirage-project / mirage
  Mirage: Automatically Generating Fast GPU Kernels without Programming in Triton/CUDA
  ☆601Updated last week