Alternatives and similar repositories for flash-attn-triton

Users that are interested in flash-attn-triton are comparing it to the libraries listed below

• JL-er / RWKV-PEFT
  ☆145Updated 3 weeks ago
• yuunnn-w / RWKV_Pytorch
  This is an inference framework for the RWKV large language model implemented purely in native PyTorch. The official native implementation…
  ☆130Updated last year
• RWKV / RWKV-infctx-trainer
  RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
  ☆148Updated last year
• chu-tianxiang / llama-cpp-torch
  llama.cpp to PyTorch Converter
  ☆34Updated last year
• ssiu / flash-attention-turing
  ☆52Updated this week
• ReinForce-II / mmapeak
  ☆43Updated 5 months ago
• yynil / RWKVinLLAMA
  ☆17Updated 8 months ago
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆47Updated last year
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆159Updated 4 months ago
• RWKV / rwkv-onnx
  A converter and basic tester for rwkv onnx
  ☆43Updated last year
• KONAKONA666 / q8_kernels
  ☆76Updated 8 months ago
• neromous / RWKV-Ouroboros
  This project is established for real-time training of the RWKV model.
  ☆50Updated last year
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆188Updated this week
• Orion-zhen / abliteration
  Make abliterated models with transformers, easy and fast
  ☆86Updated 5 months ago
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆95Updated 10 months ago
• gabrielolympie / moe-pruner
  A repository aimed at pruning DeepSeek V3, R1 and R1-zero to a usable size
  ☆68Updated last week
• cryscan / web-rwkv-inspector
  ☆13Updated 8 months ago
• stduhpf / stable-diffusion.cpp
  Stable Diffusion and Flux in pure C/C++
  ☆21Updated this week
• LeanModels / DFloat11
  DFloat11: Lossless LLM Compression for Efficient GPU Inference
  ☆536Updated 3 weeks ago
• OpenMOSE / RWKV-LM-RLHF
  Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…
  ☆54Updated 3 weeks ago
• reka-ai / rekaquant
  ☆61Updated 2 months ago
• mjun0812 / flash-attention-prebuild-wheels
  Provide with pre-build flash-attention package wheels on Linux and Windows platforms using GitHub Actions
  ☆220Updated 2 weeks ago
• qwopqwop200 / gptqlora
  GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
  ☆103Updated 2 years ago
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated 2 years ago
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆88Updated 3 weeks ago
• Tencent / AngelSlim
  Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
  ☆122Updated last week
• Cornell-RelaxML / yaqa-quantization
  ☆56Updated 2 months ago
• shoumenchougou / Awesome-RWKV-Prompts
  用户友好、开箱即用的 RWKV Prompts 示例，适用于所有用户。Awesome RWKV Prompts for general users, more user-friendly, ready-to-use prompt examples.
  ☆36Updated 7 months ago
• AIIRWKV / RWKV-RAG
  RAG SYSTEM FOR RWKV
  ☆51Updated 9 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆200Updated this week