Alternatives and similar repositories for mmapeak

Users that are interested in mmapeak are comparing it to the libraries listed below

• aikitoria / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆103Updated last month
• Cornell-RelaxML / qtip
  ☆162Updated 6 months ago
• LeanModels / DFloat11
  DFloat11 [NeurIPS '25]: Lossless Compression of LLMs and DiTs for Efficient GPU Inference
  ☆589Updated last month
• vllm-project / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆228Updated this week
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆73Updated 11 months ago
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆207Updated this week
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆50Updated last year
• KONAKONA666 / q8_kernels
  ☆79Updated last year
• mag- / gpu_benchmark
  Gpu benchmark
  ☆73Updated 11 months ago
• dropbox / gemlite
  Fast low-bit matmul kernels in Triton
  ☆418Updated 3 weeks ago
• deepreinforce-ai / CUDA-L1
  CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning
  ☆277Updated 2 months ago
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆330Updated this week
• meta-pytorch / tritonparse
  TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels
  ☆182Updated this week
• IST-DASLab / Quartet
  ☆114Updated last week
• microsoft / BitBLAS
  BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
  ☆741Updated 5 months ago
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆351Updated last year
• HazyResearch / Megakernels
  kernels, of the mega variety
  ☆640Updated 3 months ago
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆115Updated 11 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆270Updated last week
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆198Updated 2 weeks ago
• microsoft / VPTQ
  VPTQ, A Flexible and Extreme low-bit quantization algorithm
  ☆671Updated 8 months ago
• apple / ml-recurrent-drafter
  ☆219Updated 11 months ago
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆276Updated 5 months ago
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆128Updated 9 months ago
• sekstini / gpupoor
  ☆18Updated last year
• gpu-mode / popcorn-cli
  ☆83Updated last month
• meta-pytorch / BackendBench
  Ship correct and fast LLM kernels to PyTorch
  ☆130Updated this week
• Cornell-RelaxML / yaqa-quantization
  ☆69Updated 6 months ago
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆99Updated 7 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆94Updated this week