Alternatives and similar repositories for jax-flash-attn3

Users that are interested in jax-flash-attn3 are comparing it to the libraries listed below

• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆19Updated last week
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last year
• BBuf / flash-rwkv
  ☆32Updated last year
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆46Updated 11 months ago
• sgl-project / tensorrt-demo
  TensorRT LLM Benchmark Configuration
  ☆13Updated last year
• tridao / flash-attention-wheels
  ☆57Updated last year
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆26Updated 2 years ago
• UmerHA / triton_util
  Make triton easier
  ☆48Updated last year
• belindal / state-tracking
  Code and data for paper "(How) do Language Models Track State?"
  ☆20Updated 7 months ago
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆44Updated this week
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆73Updated last year
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆112Updated last year
• microsoft / AttentionEngine
  ☆109Updated 6 months ago
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
  ☆45Updated 5 months ago
• deepspeedai / DeepSpeed-Kernels
  ☆71Updated 7 months ago
• NVIDIA / free-threaded-python
  No-GIL Python environment featuring NVIDIA Deep Learning libraries.
  ☆68Updated 7 months ago
• lianakoleva / no-libtorch-compile
  ☆21Updated 8 months ago
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated 2 years ago
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆25Updated 4 months ago
• casper-hansen / AutoAWQ_kernels
  ☆78Updated 11 months ago
• tile-ai / AttentionEngine
  ☆50Updated 6 months ago
• latentCall145 / channels-last-groupnorm
  A CUDA kernel for NHWC GroupNorm for PyTorch
  ☆21Updated last year
• Yifei-Zuo / Flash-LLA
  Official repository for the paper Local Linear Attention: An Optimal Interpolation of Linear and Softmax Attention For Test-Time Regressi…
  ☆23Updated last month
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆33Updated last year
• lucidrains / simplicial-attention
  Implementation of 2-simplicial attention proposed by Clift et al. (2019) and the recent attempt to make practical in Fast and Simplex, Ro…
  ☆47Updated 2 months ago
• IBM / triton-dejavu
  Framework to reduce autotune overhead to zero for well known deployments.
  ☆85Updated 2 months ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆39Updated last year
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆42Updated last year
• TiledTensor / TiledBench
  Benchmark tests supporting the TiledCUDA library.
  ☆17Updated 11 months ago
• habanero-lab / APPy
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆25Updated this week