Alternatives and similar repositories for MicroMix

Users that are interested in MicroMix are comparing it to the libraries listed below

• SJTU-ReArch-Group / Paper-Reading-List
  ☆134Updated 3 weeks ago
• ZhW-loop / UniCoMo
  ☆12Updated last year
• DD-DuDa / Cute-Learning
  Examples of CUDA implementations by Cutlass CuTe
  ☆247Updated 4 months ago
• goliaro / specinfer-ae
  ☆23Updated last year
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆390Updated last month
• nDIRECT / nDIRECT
  A direct convolution library targeting ARM multi-core CPUs.
  ☆12Updated 11 months ago
• HPMLL / SpInfer_EuroSys25
  ☆28Updated 7 months ago
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆135Updated last week
• PDZZXL / Awesome-LLM-Serving
  Large Language Model (LLM) Serving Paper and Resource List
  ☆24Updated 5 months ago
• gty111 / GEMM_WMMA
  GEMM by WMMA (tensor core)
  ☆14Updated 3 years ago
• 66RING / tiny-flash-attention
  flash attention tutorial written in python, triton, cuda, cutlass
  ☆443Updated 6 months ago
• MoE-Inf / awesome-moe-inference
  Curated collection of papers in MoE model inference
  ☆297Updated 3 weeks ago
• DefTruth / CUDA-Learn-Notes
  📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).
  ☆50Updated 6 months ago
• reed-lau / cute-gemm
  ☆140Updated this week
• ifromeast / cuda_learning
  learning how CUDA works
  ☆338Updated 8 months ago
• MLSysU / TD-Pipe
  A Throughput-Optimized Pipeline Parallel Inference System for Large Language Models
  ☆44Updated 3 months ago
• Qwesh157 / conv_op_optimization
  This project is about convolution operator optimization on GPU, include GEMM based (Implicit GEMM) convolution.
  ☆39Updated last month
• nicolaswilde / cuda-tensorcore-hgemm
  ☆156Updated 10 months ago
• nicolaswilde / cuda-sgemm
  ☆70Updated 10 months ago
• Bruce-Lee-LY / cuda_hgemm
  Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…
  ☆495Updated last year
• snu-comparch / InfiniGen
  InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
  ☆157Updated last year
• jychen21 / Habana-LLM-Viewer
  ☆11Updated last year
• infinigence / SpecEE
  Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)
  ☆67Updated 6 months ago
• CalebDu / Awesome-Cute
  ☆110Updated 5 months ago
• HPMLL / DTC-SpMM_ASPLOS24
  ☆38Updated last year
• ArthurinRUC / cutlass-notes
  From Minimal GEMM to Everything
  ☆73Updated this week
• Cambricon / triton-linalg
  Development repository for the Triton-Linalg conversion
  ☆204Updated 9 months ago
• CRAFT-THU / RoDe
  A Row Decomposition-based Approach for Sparse Matrix Multiplication on GPUs
  ☆26Updated last year
• TreeAI-Lab / Awesome-KV-Cache-Management
  This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…
  ☆237Updated 3 months ago
• SiriusNEO / Triton-Puzzles-Lite
  Puzzles for learning Triton, play it with minimal environment configuration!
  ☆561Updated last month