Alternatives and similar repositories for flash-attn-triton

Users that are interested in flash-attn-triton are comparing it to the libraries listed below

• Joluck / RWKV-PEFT
  ☆162Updated 2 weeks ago
• RyokoAI / BigKnow2022
  BigKnow2022: Bringing Language Models Up to Speed
  ☆16Updated 2 years ago
• gabrielolympie / moe-pruner
  A repository aimed at pruning DeepSeek V3, R1 and R1-zero to a usable size
  ☆81Updated 3 months ago
• RWKV / rwkv-onnx
  A converter and basic tester for rwkv onnx
  ☆43Updated last year
• yynil / RWKVinLLAMA
  ☆17Updated 11 months ago
• Jellyfish042 / uncheatable_eval
  Evaluating LLMs with Dynamic Data
  ☆101Updated this week
• neromous / RWKV-Ouroboros
  This project is established for real-time training of the RWKV model.
  ☆50Updated last year
• RWKV / RWKV-infctx-trainer
  RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
  ☆148Updated last year
• OpenMOSE / RWKV-Infer
  A large-scale RWKV v7(World, PRWKV, Hybrid-RWKV) inference. Capable of inference by combining multiple states(Pseudo MoE). Easy to deploy…
  ☆46Updated 2 months ago
• NickL77 / BaldEagle
  3x Faster Inference; Unofficial implementation of EAGLE Speculative Decoding
  ☆82Updated 5 months ago
• OpenMOSE / RWKV-LM-RLHF
  Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…
  ☆59Updated 3 months ago
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆61Updated last year
• ssiu / flash-attention-turing
  ☆62Updated 2 weeks ago
• AIIRWKV / RWKV-RAG
  RAG SYSTEM FOR RWKV
  ☆51Updated last year
• qwopqwop200 / gptqlora
  GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
  ☆101Updated 2 years ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆108Updated last year
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆64Updated 2 years ago
• yuunnn-w / RWKV_Pytorch
  This is an inference framework for the RWKV large language model implemented purely in native PyTorch. The official native implementation…
  ☆132Updated last year
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated 2 years ago
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆205Updated this week
• shoumenchougou / Awesome-RWKV-Prompts
  用户友好、开箱即用的 RWKV Prompts 示例，适用于所有用户。Awesome RWKV Prompts for general users, more user-friendly, ready-to-use prompt examples.
  ☆35Updated 11 months ago
• harrisonvanderbyl / rwkvstic
  Framework agnostic python runtime for RWKV models
  ☆147Updated 2 years ago
• BBuf / RWKV-World-HF-Tokenizer
  ☆34Updated last year
• vmarinowski / infini-attention
  An unofficial pytorch implementation of 'Efficient Infinite Context Transformers with Infini-attention'
  ☆54Updated last year
• Triang-jyed-driung / RWKV-LM-RLHF-DPO
  Direct Preference Optimization for RWKV, aiming for RWKV-5 and 6.
  ☆11Updated last year
• KohakuBlueleaf / guanaco-lora
  Instruct-tune LLaMA on consumer hardware
  ☆72Updated 2 years ago
• Minami-su / character_AI_open
  Generate multi-round conversation roleplay data based on self-instruct and evol-instruct.
  ☆137Updated 11 months ago
• LeonEricsson / llmcontext
  Pressure testing the context window of open LLMs
  ☆25Updated last year
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆81Updated last year
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆58Updated last year