Alternatives and similar repositories for MicroMix

Users that are interested in MicroMix are comparing it to the libraries listed below

• SJTU-ReArch-Group / Paper-Reading-List
  ☆145Updated last month
• goliaro / specinfer-ae
  ☆26Updated last year
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆173Updated 2 months ago
• MoE-Inf / awesome-moe-inference
  Curated collection of papers in MoE model inference
  ☆341Updated 3 months ago
• ZhW-loop / UniCoMo
  ☆12Updated last year
• HPMLL / SpInfer_EuroSys25
  ☆31Updated 10 months ago
• PDZZXL / Awesome-LLM-Serving
  Large Language Model (LLM) Serving Paper and Resource List
  ☆24Updated 8 months ago
• DD-DuDa / Cute-Learning
  Examples of CUDA implementations by Cutlass CuTe
  ☆270Updated 7 months ago
• yifanlu0227 / LLaMA2-7B-on-laptop
  Lab 5 project of MIT-6.5940, deploying LLaMA2-7B-chat on one's laptop with TinyChatEngine.
  ☆18Updated 2 years ago
• gty111 / GEMM_WMMA
  GEMM by WMMA (tensor core)
  ☆14Updated 3 years ago
• nDIRECT / nDIRECT
  A direct convolution library targeting ARM multi-core CPUs.
  ☆12Updated last year
• DefTruth / CUDA-Learn-Notes
  📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).
  ☆63Updated 9 months ago
• reed-lau / cute-gemm
  ☆161Updated 3 months ago
• PrincetonUniversity / LLMCompass
  ☆224Updated 3 months ago
• BrotherHappy / OSTQuant
  [ICLR2025]: OSTQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fitt…
  ☆88Updated 10 months ago
• HPMLL / DTC-SpMM_ASPLOS24
  ☆45Updated last year
• snu-comparch / InfiniGen
  InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
  ☆174Updated last year
• ArthurinRUC / cutlass-notes
  From Minimal GEMM to Everything
  ☆104Updated last month
• clevercool / ANT-Quantization
  ☆113Updated 2 years ago
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆404Updated this week
• infinigence / SpecEE
  Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)
  ☆70Updated 9 months ago
• nicolaswilde / cuda-sgemm
  ☆70Updated last year
• microsoft / microxcaling
  PyTorch emulation library for Microscaling (MX)-compatible data formats
  ☆340Updated 7 months ago
• TreeAI-Lab / Awesome-KV-Cache-Management
  This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…
  ☆281Updated 2 months ago
• UDC-GAC / venom
  A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores
  ☆57Updated 2 years ago
• OpenBitSys / BitDecoding
  [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆80Updated last month
• Bruce-Lee-LY / cuda_hgemm
  Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…
  ☆522Updated last year
• 66RING / tiny-flash-attention
  flash attention tutorial written in python, triton, cuda, cutlass
  ☆484Updated 2 weeks ago
• hahnyuan / LLM-Viewer
  Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline mod…
  ☆617Updated last year
• SiriusNEO / Triton-Puzzles-Lite
  Puzzles for learning Triton, play it with minimal environment configuration!
  ☆624Updated last month