Alternatives and similar repositories for AI-Infra-from-Zero-to-Hero

Users that are interested in AI-Infra-from-Zero-to-Hero are comparing it to the libraries listed below

• AmberLJC / LLMSys-PaperList
  Large Language Model (LLM) Systems Paper List
  ☆1,787Updated 2 weeks ago
• zhaochenyang20 / Awesome-ML-SYS-Tutorial
  My learning notes for ML SYS.
  ☆5,157Updated this week
• gpu-mode / lectures
  Material for gpu-mode lectures
  ☆5,640Updated last month
• xlite-dev / Awesome-LLM-Inference
  📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
  ☆4,936Updated last week
• BBuf / how-to-optim-algorithm-in-cuda
  how to optimize some algorithm in cuda.
  ☆2,785Updated last week
• BBuf / tvm_mlir_learn
  compiler learning resources collect.
  ☆2,668Updated 10 months ago
• merrymercy / awesome-tensor-compilers
  A list of awesome compiler projects and papers for tensor computation and deep learning.
  ☆2,720Updated last year
• openmlsys / openmlsys-zh
  《Machine Learning Systems: Design and Implementation》- Chinese Version
  ☆4,751Updated last year
• PaddleJitLab / CUDATutorial
  A self-learning tutorail for CUDA High Performance Programing.
  ☆854Updated 2 weeks ago
• microsoft / AI-System
  System for AI Education Resource.
  ☆4,205Updated last year
• Jack47 / hack-SysML
  The road to hack SysML and become an system expert
  ☆510Updated last year
• gpu-mode / awesomeMLSys
  An ML Systems Onboarding list
  ☆977Updated last year
• xlite-dev / LeetCUDA
  📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉
  ☆9,472Updated last week
• AmadeusChan / Awesome-LLM-System-Papers
  ☆626Updated 2 weeks ago
• Liu-xiandong / How_to_optimize_in_GPU
  This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…
  ☆1,228Updated 2 years ago
• bharathgs / Awesome-Distributed-Deep-Learning
  A curated list of awesome Distributed Deep Learning resources.
  ☆438Updated last year
• sgl-project / mini-sglang
  A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
  ☆3,211Updated last week
• godweiyang / NN-CUDA-Example
  Several simple examples for popular neural network toolkits calling custom CUDA operators.
  ☆1,526Updated 4 years ago
• flashinfer-ai / flashinfer
  FlashInfer: Kernel Library for LLM Serving
  ☆4,768Updated this week
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆2,246Updated last year
• byungsoo-oh / ml-systems-papers
  Curated collection of papers in machine learning systems
  ☆500Updated last month
• Tony-Tan / CUDA_Freshman
  ☆2,670Updated 2 years ago
• tqchen / tinyflow
  Tutorial code on how to build your own Deep Learning System in 2k Lines
  ☆2,017Updated 7 years ago
• AIoT-MLSys-Lab / Efficient-LLMs-Survey
  [TMLR 2024] Efficient Large Language Models: A Survey
  ☆1,251Updated 7 months ago
• flexflow / flexflow-train
  Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training
  ☆1,857Updated last week
• Tongkaio / CUDA_Kernel_Samples
  CUDA 算子手撕与面试指南
  ☆809Updated 5 months ago
• l0ngc / hpc-learning
  hpc-learning
  ☆776Updated last year
• d2l-ai / d2l-tvm
  Dive into Deep Learning Compiler
  ☆645Updated 3 years ago
• ucbrise / cs294-ai-sys-sp19
  CS294; AI For Systems and Systems For AI
  ☆227Updated 6 years ago
• bytedance / byteps
  A high performance and generic framework for distributed DNN training
  ☆3,717Updated 2 years ago