Alternatives and similar repositories for lectures

Users that are interested in lectures are comparing it to the libraries listed below

• gpu-mode / resource-stream
  GPU programming related news and material links
  ☆1,945Updated 4 months ago
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆2,271Updated last year
• xlite-dev / LeetCUDA
  📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉
  ☆9,536Updated 2 weeks ago
• BBuf / how-to-optim-algorithm-in-cuda
  how to optimize some algorithm in cuda.
  ☆2,801Updated this week
• gpu-mode / awesomeMLSys
  An ML Systems Onboarding list
  ☆977Updated last year
• flashinfer-ai / flashinfer
  FlashInfer: Kernel Library for LLM Serving
  ☆4,853Updated this week
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆3,108Updated last week
• tile-ai / tilelang
  Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels
  ☆4,863Updated this week
• xlite-dev / Awesome-LLM-Inference
  📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
  ☆4,953Updated 2 weeks ago
• zhaochenyang20 / Awesome-ML-SYS-Tutorial
  My learning notes for ML SYS.
  ☆5,242Updated this week
• huggingface / picotron
  Minimalistic 4D-parallelism distributed training framework for education purpose
  ☆2,058Updated 5 months ago
• siboehm / SGEMM_CUDA
  Fast CUDA matrix multiplication from scratch
  ☆1,040Updated 5 months ago
• olcf / cuda-training-series
  Training materials associated with NVIDIA's CUDA Training Series (www.olcf.ornl.gov/cuda-training-series/)
  ☆934Updated last year
• mirage-project / mirage
  Mirage Persistent Kernel: Compiling LLMs into a MegaKernel
  ☆2,104Updated this week
• NVIDIA / TransformerEngine
  A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…
  ☆3,132Updated this week
• pytorch / torchtitan
  A PyTorch native platform for training generative AI models
  ☆5,023Updated this week
• minitorch / minitorch
  The full minitorch student suite.
  ☆2,287Updated last year
• Liu-xiandong / How_to_optimize_in_GPU
  This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…
  ☆1,233Updated 2 years ago
• tspeterkim / flash-attention-minimal
  Flash Attention in ~100 lines of CUDA (forward pass only)
  ☆1,067Updated last year
• NVIDIA / cutlass
  CUDA Templates and Python DSLs for High-Performance Linear Algebra
  ☆9,185Updated last week
• fla-org / flash-linear-attention
  🚀 Efficient implementations of state-of-the-art linear attention models
  ☆4,311Updated this week
• Infatoshi / cuda-course
  ☆2,866Updated 3 months ago
• AmberLJC / LLMSys-PaperList
  Large Language Model (LLM) Systems Paper List
  ☆1,787Updated 3 weeks ago
• PaddleJitLab / CUDATutorial
  A self-learning tutorail for CUDA High Performance Programing.
  ☆866Updated 3 weeks ago
• sgl-project / mini-sglang
  A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
  ☆3,297Updated 2 weeks ago
• PacktPublishing / Learn-CUDA-Programming
  Learn CUDA Programming, published by Packt
  ☆1,228Updated 2 years ago
• Tony-Tan / CUDA_Freshman
  ☆2,683Updated 2 years ago
• HuaizhengZhang / AI-Infra-from-Zero-to-Hero
  🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Mod…
  ☆3,655Updated 6 months ago
• BBuf / tvm_mlir_learn
  compiler learning resources collect.
  ☆2,675Updated 10 months ago
• NVIDIA / accelerated-computing-hub
  NVIDIA curated collection of educational resources related to general purpose GPU programming.
  ☆1,146Updated this week