Alternatives and similar repositories for fp8-quant-matmul

Users that are interested in fp8-quant-matmul are comparing it to the libraries listed below

• Snektron / gpumode-amd-fp8-mm
  My submission for the GPUMODE/AMD fp8 mm challenge
  ☆29Updated 6 months ago
• IST-DASLab / Quartet
  ☆114Updated last month
• huggingface / hf-rocm-kernels
  ☆23Updated 5 months ago
• Cornell-RelaxML / yaqa-quantization
  ☆68Updated 6 months ago
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆96Updated 7 months ago
• meta-pytorch / tritonparse
  TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels
  ☆179Updated this week
• AMD-AGI / GEAK-agent
  It is an LLM-based AI agent, which can write correct and efficient gpu kernels automatically.
  ☆49Updated last week
• cherichy / tilecute
  ☆32Updated 5 months ago
• Anonymous1252022 / fp4-all-the-way
  ☆43Updated 7 months ago
• aryagxr / cuda
  coding CUDA everyday!
  ☆72Updated 3 weeks ago
• tgautam03 / tGeMM
  General Matrix Multiplication using NVIDIA Tensor Cores
  ☆27Updated 11 months ago
• WaveSpeedAI / QuantumAttention
  [WIP] Better (FP8) attention for Hopper
  ☆32Updated 10 months ago
• kuterd / opal_ptx
  Experimental GPU language with meta-programming
  ☆24Updated last year
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆114Updated 11 months ago
• abdelfattah-lab / nitro
  Lightweight Python Wrapper for OpenVINO, enabling LLM inference on NPUs
  ☆26Updated last year
• microsoft / AttentionEngine
  ☆115Updated 7 months ago
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆128Updated 9 months ago
• AutonomicPerfectionist / PipeInfer
  PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation
  ☆31Updated last year
• flashinfer-ai / cutlass-viz
  ☆65Updated 8 months ago
• gpu-mode / popcorn-cli
  ☆84Updated 3 weeks ago
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
  ☆46Updated 6 months ago
• Infatoshi / docs.md
  ☆84Updated 2 weeks ago
• aikitoria / nanotrace
  Low overhead tracing library and trace visualizer for pipelined CUDA kernels
  ☆127Updated last month
• deepreinforce-ai / CUDA-L2
  CUDA-L2: Surpassing cuBLAS Performance for Matrix Multiplication through Reinforcement Learning
  ☆252Updated 2 weeks ago
• tile-ai / AttentionEngine
  ☆52Updated 7 months ago
• cpldcpu / LRMTokenEconomy
  Measuring Thinking Efficiency in Reasoning Models - Research Repository
  ☆37Updated 3 weeks ago
• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆53Updated 9 months ago
• sgl-project / sgl-cookbook
  Cookbook of SGLang - Recipe
  ☆48Updated this week
• RadeonFlow / RadeonFlow_Kernels
  Efficient implementation of DeepSeek Ops (Blockwise FP8 GEMM, MoE, and MLA) for AMD Instinct MI300X
  ☆74Updated last month
• sgl-project / DeepGEMM
  DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
  ☆21Updated 2 weeks ago