Alternatives and similar repositories for md-blogs:

Users that are interested in md-blogs are comparing it to the libraries listed below

• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆123Updated last year
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆145Updated this week
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆30Updated this week
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆32Updated 4 months ago
• sangmichaelxie / cs324_p2
  Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)
  ☆101Updated last year
• okarthikb / state-space-models
  ☆27Updated 7 months ago
• AllanYangZhou / midGPT
  Distributed pretraining of large language models (LLMs) on cloud TPU slices, with Jax and Equinox.
  ☆24Updated 5 months ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆99Updated 3 months ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆81Updated last year
• vdesai2014 / inference-optimization-blog-post
  ☆86Updated last year
• sholtodouglas / scalingExperiments
  ☆58Updated 3 years ago
• google-deepmind / asyncdiloco
  ☆42Updated last year
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆76Updated last year
• cloneofsimo / min-fsdp
  ☆75Updated 7 months ago
• srush / anynp
  Proof-of-concept of global switching between numpy/jax/pytorch in a library.
  ☆18Updated 8 months ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆58Updated last year
• dshah3 / GPU-Puzzles
  Solve puzzles. Learn CUDA.
  ☆62Updated last year
• linjames0 / Transformer-CUDA
  An implementation of the transformer architecture onto an Nvidia CUDA kernel
  ☆171Updated last year
• thecharlieblake / lovely-llama
  An implementation of the Llama architecture, to instruct and delight
  ☆21Updated last month
• ezyang / torchdbg
  PyTorch centric eager mode debugger
  ☆46Updated 2 months ago
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆119Updated 6 months ago
• gau-nernst / learn-cuda
  Learn CUDA with PyTorch
  ☆18Updated last month
• ScalingIntelligence / KernelBench
  KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems
  ☆214Updated this week
• CerebrasResearch / Sparse-IFT
  Official repository of Sparse ISO-FLOP Transformations for Maximizing Training Efficiency
  ☆25Updated 7 months ago
• gpu-mode / profiling-cuda-in-torch
  ☆145Updated last year
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated 10 months ago
• HazyResearch / train-tk
  train with kittens!
  ☆53Updated 4 months ago
• Jaykef / Triton-nanoGPT
  Custom triton kernels for training Karpathy's nanoGPT.
  ☆17Updated 4 months ago
• Jokeren / triton-samples
  ☆26Updated last month
• kyo-takano / chinchilla
  A toolkit for scaling law research ⚖
  ☆47Updated last month