Alternatives and similar repositories for lectures:

Users that are interested in lectures are comparing it to the libraries listed below

• gpu-mode / resource-stream
  GPU programming related news and material links
  ☆1,412Updated 2 months ago
• DefTruth / CUDA-Learn-Notes
  📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).
  ☆2,901Updated this week
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,508Updated 4 months ago
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆2,153Updated this week
• BBuf / how-to-optim-algorithm-in-cuda
  how to optimize some algorithm in cuda.
  ☆2,022Updated this week
• flashinfer-ai / flashinfer
  FlashInfer: Kernel Library for LLM Serving
  ☆2,439Updated this week
• gpu-mode / awesomeMLSys
  An ML Systems Onboarding list
  ☆730Updated last month
• pytorch / torchtitan
  A PyTorch native library for large model training
  ☆3,470Updated this week
• DefTruth / Awesome-LLM-Inference
  📖A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, Flash-Attention, Paged-Attention, Parallelism, etc. 🎉🎉
  ☆3,675Updated 2 weeks ago
• siboehm / SGEMM_CUDA
  Fast CUDA matrix multiplication from scratch
  ☆663Updated last year
• NVIDIA / TransformerEngine
  A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs…
  ☆2,293Updated this week
• zhaochenyang20 / Awesome-ML-SYS-Tutorial
  My learning notes/codes for ML SYS.
  ☆1,481Updated this week
• tspeterkim / flash-attention-minimal
  Flash Attention in ~100 lines of CUDA (forward pass only)
  ☆732Updated 2 months ago
• fla-org / flash-linear-attention
  🚀 Efficient implementations of state-of-the-art linear attention models in Torch and Triton
  ☆2,111Updated this week
• Liu-xiandong / How_to_optimize_in_GPU
  This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…
  ☆960Updated last year
• pytorch / ao
  PyTorch native quantization and sparsity for training and inference
  ☆1,913Updated this week
• PacktPublishing / Learn-CUDA-Programming
  Learn CUDA Programming, published by Packt
  ☆1,120Updated last year
• olcf / cuda-training-series
  Training materials associated with NVIDIA's CUDA Training Series (www.olcf.ornl.gov/cuda-training-series/)
  ☆721Updated 7 months ago
• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆1,016Updated last year
• minitorch / minitorch
  The full minitorch student suite.
  ☆2,029Updated 7 months ago
• huggingface / picotron
  Minimalistic 4D-parallelism distributed training framework for education purpose
  ☆935Updated 2 weeks ago
• PaddleJitLab / CUDATutorial
  A self-learning tutorail for CUDA High Performance Programing.
  ☆465Updated 2 weeks ago
• HazyResearch / aisys-building-blocks
  Building blocks for foundation models.
  ☆464Updated last year
• Infatoshi / cuda-course
  ☆960Updated 2 months ago
• mirage-project / mirage
  Mirage: Automatically Generating Fast GPU Kernels without Programming in Triton/CUDA
  ☆769Updated this week
• Tony-Tan / CUDA_Freshman
  ☆2,366Updated last year
• clu0 / unet.cu
  UNet diffusion model in pure CUDA
  ☆600Updated 8 months ago
• mit-han-lab / llm-awq
  [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
  ☆2,861Updated this week
• KellerJordan / modded-nanogpt
  NanoGPT (124M) in 3 minutes
  ☆2,403Updated this week