Alternatives and similar repositories for MicroMix

Users that are interested in MicroMix are comparing it to the libraries listed below

• SJTU-ReArch-Group / Paper-Reading-List
  ☆139Updated 2 weeks ago
• goliaro / specinfer-ae
  ☆23Updated last year
• PDZZXL / Awesome-LLM-Serving
  Large Language Model (LLM) Serving Paper and Resource List
  ☆24Updated 6 months ago
• HPMLL / SpInfer_EuroSys25
  ☆29Updated 8 months ago
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆139Updated this week
• infinigence / SpecEE
  Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)
  ☆67Updated 7 months ago
• HPMLL / DTC-SpMM_ASPLOS24
  ☆41Updated last year
• PrincetonUniversity / LLMCompass
  ☆209Updated last month
• jychen21 / Habana-LLM-Viewer
  ☆11Updated last year
• ZhW-loop / UniCoMo
  ☆12Updated last year
• MLSysU / TD-Pipe
  A Throughput-Optimized Pipeline Parallel Inference System for Large Language Models
  ☆44Updated 4 months ago
• MoE-Inf / awesome-moe-inference
  Curated collection of papers in MoE model inference
  ☆308Updated last month
• nDIRECT / nDIRECT
  A direct convolution library targeting ARM multi-core CPUs.
  ☆12Updated last year
• DD-DuDa / Cute-Learning
  Examples of CUDA implementations by Cutlass CuTe
  ☆254Updated 5 months ago
• CRAFT-THU / RoDe
  A Row Decomposition-based Approach for Sparse Matrix Multiplication on GPUs
  ☆27Updated 2 years ago
• DD-DuDa / BitDecoding
  [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆63Updated 2 weeks ago
• TreeAI-Lab / Awesome-KV-Cache-Management
  This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…
  ☆255Updated 4 months ago
• casys-kaist / casys-kaist.github.io
  ☆19Updated last month
• snu-comparch / InfiniGen
  InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
  ☆163Updated last year
• clevercool / ANT-Quantization
  ☆113Updated 2 years ago
• sjtu-zhao-lab / ClusterKV
  ClusterKV: Manipulating LLM KV Cache in Semantic Space for Recallable Compression (DAC'25)
  ☆19Updated 2 months ago
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆394Updated last month
• nicolaswilde / cuda-tensorcore-hgemm
  ☆156Updated 11 months ago
• reed-lau / cute-gemm
  ☆151Updated 3 weeks ago
• BrotherHappy / OSTQuant
  [ICLR2025]: OSTQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fitt…
  ☆84Updated 7 months ago
• yifanlu0227 / LLaMA2-7B-on-laptop
  Lab 5 project of MIT-6.5940, deploying LLaMA2-7B-chat on one's laptop with TinyChatEngine.
  ☆18Updated 2 years ago
• DefTruth / CUDA-Learn-Notes
  📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).
  ☆51Updated 7 months ago
• 66RING / tiny-flash-attention
  flash attention tutorial written in python, triton, cuda, cutlass
  ☆454Updated 6 months ago
• AI-Infra-Team / awesome-papers
  Paper reading and discussion notes, covering AI frameworks, distributed systems, cluster management, etc.
  ☆43Updated 3 weeks ago
• Qwesh157 / conv_op_optimization
  This project is about convolution operator optimization on GPU, include GEMM based (Implicit GEMM) convolution.
  ☆38Updated 2 months ago