Alternatives and similar repositories for jax-flash-attn3

Users that are interested in jax-flash-attn3 are comparing it to the libraries listed below

• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆19Updated this week
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last year
• BBuf / flash-rwkv
  ☆32Updated last year
• casper-hansen / AutoAWQ_kernels
  ☆78Updated last year
• habanero-lab / APPy
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆27Updated last week
• UmerHA / triton_util
  Make triton easier
  ☆49Updated last year
• latentCall145 / channels-last-groupnorm
  A CUDA kernel for NHWC GroupNorm for PyTorch
  ☆22Updated last year
• sgl-project / DeepGEMM
  DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
  ☆21Updated last week
• facebookresearch / any4
  Quantize transformers to any learned arbitrary 4-bit numeric format
  ☆50Updated 5 months ago
• belindal / state-tracking
  Code and data for paper "(How) do Language Models Track State?"
  ☆21Updated 8 months ago
• hazan-lab / flash-stu
  PyTorch implementation of the Flash Spectral Transform Unit.
  ☆21Updated last year
• li-plus / flash-preference
  Accelerate LLM preference tuning via prefix sharing with a single line of code
  ☆51Updated 5 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆27Updated 2 years ago
• caibucai22 / awesome-cuda
  Awesome code, projects, books, etc. related to CUDA
  ☆28Updated 2 weeks ago
• onnx / neural-compressor
  Model compression for ONNX
  ☆99Updated last year
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆46Updated this week
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆112Updated last year
• WaveSpeedAI / QuantumAttention
  [WIP] Better (FP8) attention for Hopper
  ☆32Updated 10 months ago
• microsoft / AttentionEngine
  ☆115Updated 7 months ago
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆33Updated last year
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆25Updated 5 months ago
• GeeeekExplorer / transformers-patch
  patches for huggingface transformers to save memory
  ☆32Updated 6 months ago
• thib-s / flash-newton-schulz
  My attempt to improve the speed of the newton schulz algorithm, starting from the dion implementation.
  ☆24Updated 3 weeks ago
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆44Updated last year
• tridao / flash-attention-wheels
  ☆59Updated 2 years ago
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
  ☆46Updated 6 months ago
• tile-ai / AttentionEngine
  ☆52Updated 7 months ago
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆46Updated last year
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated 2 years ago
• Bruce-Lee-LY / cutlass_gemm
  Multiple GEMM operators are constructed with cutlass to support LLM inference.
  ☆20Updated 4 months ago