Alternatives and similar repositories for FlashMLA

Users that are interested in FlashMLA are comparing it to the libraries listed below

• OpenPPL / CuAssembler
  An unofficial cuda assembler, for all generations of SASS, hopefully ：）
  ☆83Updated 2 years ago
• bytedance / ByteMLPerf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆251Updated 3 weeks ago
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆102Updated 2 months ago
• FlagOpen / FlagCX
  ☆80Updated this week
• xlite-dev / HGEMM
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆87Updated 2 months ago
• TiledTensor / TiledCUDA
  We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …
  ☆184Updated 5 months ago
• pigirons / conv3x3_m1
  This is a demo how to write a high performance convolution run on apple silicon
  ☆54Updated 3 years ago
• chenyu-jiang / nsys2json
  A Python script to convert the output of NVIDIA Nsight Systems (in SQLite format) to JSON in Google Chrome Trace Event Format.
  ☆38Updated 5 months ago
• zw0610 / zw0610.github.io
  ☆58Updated 4 years ago
• vllm-project / flash-attention
  Fast and memory-efficient exact attention
  ☆81Updated last week
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆70Updated last week
• Ascend / triton-ascend
  Triton adapter for Ascend. Mirror of https://gitee.com/ascend/triton-ascend
  ☆59Updated this week
• AI-HPC-Research-Team / AIPerf
  Automated machine learning as an AI-HPC benchmark
  ☆66Updated 3 years ago
• alibaba / heterogeneity-aware-lowering-and-optimization
  heterogeneity-aware-lowering-and-optimization
  ☆255Updated last year
• DeepLink-org / CVFusion
  CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.
  ☆30Updated 2 years ago
• UDC-GAC / venom
  A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores
  ☆52Updated last year
• QianyanTech / NBAssembler
  Assembler and Decompiler for NVIDIA (Maxwell Pascal Volta Turing Ampere) GPUs.
  ☆81Updated 2 years ago
• billmuch / matmul_perf_test
  ☆14Updated 3 years ago
• wmmae / wmma_extension
  An extension library of WMMA API (Tensor Core API)
  ☆99Updated last year
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆93Updated this week
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆79Updated 8 months ago
• thu-pacman / PET
  PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections
  ☆121Updated 3 years ago
• ParCoreLab / Snoopie
  Multi-GPU communication profiler and visualizer
  ☆31Updated last year
• sjtu-epcc / Tacker
  Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS
  ☆29Updated 5 months ago
• FlagTree / flagtree
  FlagTree is a unified compiler for multiple AI chips, which is forked from triton-lang/triton.
  ☆64Updated this week
• microsoft / TileFusion
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.
  ☆91Updated 3 weeks ago
• ROCm / TransformerEngine
  ☆40Updated this week
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆111Updated 10 months ago
• GVProf / GVProf
  GVProf: A Value Profiler for GPU-based Clusters
  ☆51Updated last year
• OSU-Nowlab / Flover
  A novel temporal fusion framework for propelling autoregressive model inference
  ☆11Updated this week