Alternatives and similar repositories for hw1

Users that are interested in hw1 are comparing it to the libraries listed below

• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆38Updated 3 months ago
• dlsyscourse / hw0
  ☆36Updated last year
• dlsyscourse / lecture5
  ☆20Updated 9 months ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆40Updated last year
• zhuohan123 / terapipe
  ☆74Updated 4 years ago
• mlc-ai / notebooks
  ☆207Updated 7 months ago
• InternLM / turbomind
  ☆87Updated 3 months ago
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆44Updated 11 months ago
• alpha0422 / torch-graph
  Simple PyTorch graph capturing.
  ☆19Updated 2 years ago
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆57Updated last year
• l1nkr / DL-Compiler-Navigation
  Machine Learning Compiler Road Map
  ☆43Updated last year
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆130Updated last year
• flexflow / flexflow-serve
  FlexFlow Serve: Low-Latency, High-Performance LLM Serving
  ☆42Updated last month
• gfvvz / triton-learning-materials
  Triton Compiler related materials.
  ☆30Updated 5 months ago
• microsoft / chunk-attention
  ☆77Updated 2 months ago
• thu-pacman / FasterMoE
  ☆84Updated 3 years ago
• nvixnu / pmpp__programming_massively_parallel_processors
  Examples and exercises from the book Programming Massively Parallel Processors - A Hands-on Approach. David B. Kirk and Wen-mei W. Hwu (T…
  ☆69Updated 4 years ago
• kyegomez / FlashAttention20Triton
  Triton implementation of Flash Attention2.0
  ☆35Updated last year
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆39Updated 2 years ago
• mit-han-lab / tinychat-tutorial
  ☆69Updated 7 months ago
• Cjkkkk / KgeN
  A TVM-like CUDA/C code generator.
  ☆9Updated 3 years ago
• stanford-futuredata / stk
  ☆105Updated 10 months ago
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆77Updated 3 weeks ago
• AlibabaPAI / FLASHNN
  ☆97Updated 9 months ago
• S-Lab-System-Group / Awesome-ML-for-System
  SOTA Learning-augmented Systems
  ☆36Updated 3 years ago
• mit-han-lab / parallel-computing-tutorial
  ☆170Updated last year
• thu-pacman / PET
  PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections
  ☆121Updated 3 years ago
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆69Updated last month
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆100Updated 3 weeks ago
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
  ☆38Updated 2 weeks ago