Alternatives and similar repositories for mmapeak

Users that are interested in mmapeak are comparing it to the libraries listed below

• aikitoria / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆95Updated last week
• vllm-project / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆214Updated last week
• Cornell-RelaxML / qtip
  ☆159Updated 5 months ago
• mag- / gpu_benchmark
  Gpu benchmark
  ☆73Updated 10 months ago
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆73Updated 10 months ago
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆50Updated last year
• dropbox / gemlite
  Fast low-bit matmul kernels in Triton
  ☆407Updated 3 weeks ago
• KONAKONA666 / q8_kernels
  ☆76Updated 11 months ago
• IST-DASLab / Quartet
  ☆112Updated 3 weeks ago
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆203Updated last week
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆113Updated 10 months ago
• LeanModels / DFloat11
  DFloat11 [NeurIPS '25]: Lossless Compression of LLMs and DiTs for Efficient GPU Inference
  ☆572Updated 3 weeks ago
• CerebrasResearch / reap
  REAP: Router-weighted Expert Activation Pruning for SMoE compression
  ☆145Updated last week
• IST-DASLab / MoE-Quant
  Code for data-aware compression of DeepSeek models
  ☆66Updated last month
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆128Updated 9 months ago
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆322Updated this week
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆84Updated this week
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆317Updated 2 years ago
• Cornell-RelaxML / yaqa-quantization
  ☆65Updated 5 months ago
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆94Updated 6 months ago
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆137Updated last week
• IST-DASLab / qmoe
  Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".
  ☆279Updated 2 years ago
• Infini-AI-Lab / Sequoia
  scalable and robust tree-based speculative decoding algorithm
  ☆363Updated 10 months ago
• neuralmagic / AutoFP8
  ☆205Updated 7 months ago
• gpu-mode / popcorn-cli
  ☆81Updated last week
• meta-pytorch / tritonparse
  TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels
  ☆178Updated this week
• gpu-mode / ring-attention
  ring-attention experiments
  ☆160Updated last year
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆148Updated 10 months ago
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆25Updated 5 months ago
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆272Updated 5 months ago