Alternatives and similar repositories for MicroMix

Users that are interested in MicroMix are comparing it to the libraries listed below

• goliaro / specinfer-ae
  ☆26Updated last year
• SJTU-ReArch-Group / Paper-Reading-List
  ☆143Updated last month
• MoE-Inf / awesome-moe-inference
  Curated collection of papers in MoE model inference
  ☆338Updated 3 months ago
• nDIRECT / nDIRECT
  A direct convolution library targeting ARM multi-core CPUs.
  ☆12Updated last year
• HPMLL / SpInfer_EuroSys25
  ☆31Updated 9 months ago
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆168Updated 2 months ago
• PDZZXL / Awesome-LLM-Serving
  Large Language Model (LLM) Serving Paper and Resource List
  ☆24Updated 8 months ago
• ZhW-loop / UniCoMo
  ☆12Updated last year
• PrincetonUniversity / LLMCompass
  ☆218Updated 3 months ago
• infinigence / SpecEE
  Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)
  ☆70Updated 9 months ago
• DD-DuDa / Cute-Learning
  Examples of CUDA implementations by Cutlass CuTe
  ☆269Updated 6 months ago
• DefTruth / CUDA-Learn-Notes
  📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).
  ☆62Updated 9 months ago
• ArthurinRUC / cutlass-notes
  From Minimal GEMM to Everything
  ☆98Updated 3 weeks ago
• snu-comparch / InfiniGen
  InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
  ☆174Updated last year
• gty111 / GEMM_WMMA
  GEMM by WMMA (tensor core)
  ☆14Updated 3 years ago
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆404Updated 3 weeks ago
• HPMLL / DTC-SpMM_ASPLOS24
  ☆45Updated last year
• yifu-ding / BGEMM-CUDA
  This is a repository of Binary General Matrix Multiply (BGEMM) by customized CUDA kernel. Thank FP6-LLM for the wheels!
  ☆18Updated last year
• clevercool / ANT-Quantization
  ☆113Updated 2 years ago
• violetDelia / MLIR-Tutorial
  ☆77Updated 3 months ago
• nicolaswilde / cuda-tensorcore-hgemm
  ☆156Updated last year
• nicolaswilde / cuda-sgemm
  ☆70Updated last year
• yifanlu0227 / LLaMA2-7B-on-laptop
  Lab 5 project of MIT-6.5940, deploying LLaMA2-7B-chat on one's laptop with TinyChatEngine.
  ☆18Updated 2 years ago
• reed-lau / cute-gemm
  ☆159Updated 2 months ago
• Bruce-Lee-LY / cuda_hgemm
  Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…
  ☆517Updated last year
• ParCIS / FlashSparse
  FlashSparse significantly reduces the computation redundancy for unstructured sparsity (for SpMM and SDDMM) on Tensor Cores through a Swa…
  ☆38Updated 3 months ago
• microsoft / microxcaling
  PyTorch emulation library for Microscaling (MX)-compatible data formats
  ☆337Updated 7 months ago
• jychen21 / Habana-LLM-Viewer
  ☆12Updated last year
• CRAFT-THU / RoDe
  A Row Decomposition-based Approach for Sparse Matrix Multiplication on GPUs
  ☆28Updated 2 years ago
• OpenBitSys / BitDecoding
  [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆79Updated last month