Alternatives and similar repositories for md-blogs:

Users that are interested in md-blogs are comparing it to the libraries listed below

• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆116Updated last year
• google-deepmind / asyncdiloco
  ☆41Updated last year
• gau-nernst / learn-cuda
  Learn CUDA with PyTorch
  ☆16Updated this week
• ScalingIntelligence / KernelBench
  KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems
  ☆99Updated last week
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆136Updated 6 months ago
• cloneofsimo / min-fsdp
  ☆75Updated 6 months ago
• dshah3 / GPU-Puzzles
  Solve puzzles. Learn CUDA.
  ☆61Updated last year
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆81Updated last year
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆74Updated last year
• sholtodouglas / scalingExperiments
  ☆58Updated 2 years ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆58Updated last year
• ezyang / torchdbg
  PyTorch centric eager mode debugger
  ☆44Updated last month
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆28Updated 2 months ago
• gnovack / distributed-training-and-deepspeed
  ☆17Updated last year
• yixiaoer / tpux
  A set of Python scripts that makes your experience on TPU better
  ☆44Updated 6 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆157Updated 3 weeks ago
• vdesai2014 / inference-optimization-blog-post
  ☆85Updated 11 months ago
• cat-state / tinypar
  ☆20Updated last year
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆91Updated 2 months ago
• unixpickle / learn-ptx
  Learning about CUDA by writing PTX code.
  ☆34Updated 11 months ago
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆17Updated this week
• thesephist / hfm
  Hugging Face Download (Cache) Manager
  ☆21Updated 2 years ago
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆73Updated last month
• DS3Lab / CocktailSGD
  ☆25Updated last year
• srush / anynp
  Proof-of-concept of global switching between numpy/jax/pytorch in a library.
  ☆18Updated 7 months ago
• gpu-mode / profiling-cuda-in-torch
  ☆140Updated 11 months ago
• AllanYangZhou / midGPT
  Distributed pretraining of large language models (LLMs) on cloud TPU slices, with Jax and Equinox.
  ☆19Updated 4 months ago
• lianakoleva / no-libtorch-compile
  ☆21Updated 3 months ago
• Jaykef / Triton-nanoGPT
  Custom triton kernels for training Karpathy's nanoGPT.
  ☆16Updated 3 months ago
• Jokeren / triton-samples
  ☆24Updated 2 weeks ago