notY0rick / cuda_practice

Related projects: ⓘ

• linjames0 / Transformer-CUDA
  An implementation of the transformer architecture onto an Nvidia CUDA kernel
  ☆152Updated 11 months ago
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆88Updated 11 months ago
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆85Updated 5 months ago
• mesozoic-egg / tinygrad-notes
  Tutorials on tinygrad
  ☆157Updated 2 weeks ago
• srush / GPTWorld
  A puzzle to learn about prompting
  ☆106Updated last year
• dshah3 / GPU-Puzzles
  Solve puzzles. Learn CUDA.
  ☆53Updated 9 months ago
• smolorg / smolgrad
  small auto-grad engine inspired from Karpathy's micrograd and PyTorch
  ☆91Updated 2 months ago
• spikedoanz / from-bits-to-intelligence
  could we make an ml stack in 100,000 lines of code?
  ☆22Updated 2 months ago
• yacineMTB / just-large-models
  Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.
  ☆42Updated last year
• tspeterkim / mixed-precision-from-scratch
  Mixed precision training from scratch with Tensors and CUDA
  ☆18Updated 4 months ago
• nreHieW / r-nn
  Tensor library with autograd using only Rust's standard library
  ☆61Updated 2 months ago
• srush / raspy
  An interactive exploration of Transformer programming.
  ☆243Updated 10 months ago
• loganwatchorn / notes-pmpp
  Notes on "Programming Massively Parallel Processors" by Hwu, Kirk, and Hajj (4th ed.)
  ☆48Updated last month
• Astle-sudo / Deep-Learning-C
  ☆47Updated last month
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆293Updated last year
• ulrichstern / cuda-convnet
  Alex Krizhevsky's original code from Google Code
  ☆185Updated 8 years ago
• srush / pytorch-lecture
  Introductory lecture on Pytorch
  ☆15Updated 2 years ago
• geohot / body_loop
  comma body does a loop around the office
  ☆26Updated 10 months ago
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆126Updated last year
• Laz4rz / GPT-2
  Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish
  ☆165Updated last month
• ishan0102 / rsrch.space
  Stream of my favorite papers and links
  ☆34Updated 2 weeks ago
• Infatoshi / cuda-course
  ☆52Updated last week
• xjdr-alt / simple_transformer
  Simple Transformer in Jax
  ☆100Updated 2 months ago
• obadakhalili / tinygrad-tensor-puzzles
  Solve puzzles to improve your tinygrad skills!
  ☆70Updated last month
• omkaark / simple-federated-learning
  ☆97Updated 5 months ago
• cuda-mode / profiling-cuda-in-torch
  ☆124Updated 7 months ago
• irregular-rhomboid / EAI-Math-Reading-Group
  Resources from the EleutherAI Math Reading Group
  ☆50Updated 2 months ago
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆93Updated last year
• Chillee / llm.c
  LLM training in simple, raw C/CUDA
  ☆17Updated 4 months ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆77Updated 9 months ago