Alternatives and similar repositories for lectures

Users that are interested in lectures are comparing it to the libraries listed below

• gpu-mode / resource-stream
  GPU programming related news and material links
  ☆1,501Updated 4 months ago
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,614Updated 5 months ago
• xlite-dev / LeetCUDA
  📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA/Tensor Cores Kernels, HGEMM, FA-2 MMA etc.🔥
  ☆4,082Updated this week
• BBuf / how-to-optim-algorithm-in-cuda
  how to optimize some algorithm in cuda.
  ☆2,157Updated last week
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆2,339Updated this week
• flashinfer-ai / flashinfer
  FlashInfer: Kernel Library for LLM Serving
  ☆2,815Updated this week
• gpu-mode / awesomeMLSys
  An ML Systems Onboarding list
  ☆780Updated 3 months ago
• xlite-dev / Awesome-LLM-Inference
  📚A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, MLA, Parallelism etc.
  ☆3,964Updated last week
• huggingface / picotron
  Minimalistic 4D-parallelism distributed training framework for education purpose
  ☆1,464Updated 2 months ago
• fla-org / flash-linear-attention
  🚀 Efficient implementations of state-of-the-art linear attention models in Torch and Triton
  ☆2,357Updated last week
• NVIDIA / TransformerEngine
  A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Bla…
  ☆2,400Updated this week
• siboehm / SGEMM_CUDA
  Fast CUDA matrix multiplication from scratch
  ☆709Updated last year
• Liu-xiandong / How_to_optimize_in_GPU
  This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…
  ☆1,029Updated last year
• tspeterkim / flash-attention-minimal
  Flash Attention in ~100 lines of CUDA (forward pass only)
  ☆809Updated 4 months ago
• pytorch / ao
  PyTorch native quantization and sparsity for training and inference
  ☆2,030Updated this week
• tile-ai / tilelang
  Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels
  ☆1,108Updated this week
• zhaochenyang20 / Awesome-ML-SYS-Tutorial
  My learning notes/codes for ML SYS.
  ☆2,109Updated this week
• olcf / cuda-training-series
  Training materials associated with NVIDIA's CUDA Training Series (www.olcf.ornl.gov/cuda-training-series/)
  ☆756Updated 8 months ago
• mit-han-lab / llm-awq
  [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
  ☆2,991Updated this week
• pytorch / torchtitan
  A PyTorch native library for large-scale model training
  ☆3,675Updated this week
• AmberLJC / LLMSys-PaperList
  Large Language Model (LLM) Systems Paper List
  ☆1,221Updated this week
• Infatoshi / cuda-course
  ☆1,098Updated last month
• thuml / depyf
  depyf is a tool to help you understand and adapt to PyTorch compiler torch.compile.
  ☆666Updated 3 weeks ago
• mirage-project / mirage
  Mirage: Automatically Generating Fast GPU Kernels without Programming in Triton/CUDA
  ☆828Updated this week
• BBuf / tvm_mlir_learn
  compiler learning resources collect.
  ☆2,377Updated last month
• KellerJordan / modded-nanogpt
  NanoGPT (124M) in 3 minutes
  ☆2,533Updated 2 weeks ago
• minitorch / minitorch
  The full minitorch student suite.
  ☆2,066Updated 8 months ago
• Tony-Tan / CUDA_Freshman
  ☆2,431Updated last year
• srush / Tensor-Puzzles
  Solve puzzles. Improve your pytorch.
  ☆3,554Updated 9 months ago
• pytorch-labs / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆5,946Updated last month