Alternatives and similar repositories for flash-attention:

Users that are interested in flash-attention are comparing it to the libraries listed below

• ThereforeGames / echoproof
  Simple extension for text-generation-webui that injects recent conversation history into the negative prompt with the goal of minimizing …
  ☆33Updated last year
• ill13 / SpeakLocal
  A TTS extension for oobabooga text WebUI
  ☆31Updated last year
• FartyPants / FPreloader
  Hard Reload oobabooga text WebUI extensions
  ☆18Updated 3 months ago
• RandomInternetPreson / LucidWebSearch
  A web search extension for Oobabooga's text-generation-webui (now with nougat)
  ☆74Updated 10 months ago
• jllllll / GPTQ-for-LLaMa-CUDA
  A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.
  ☆22Updated last year
• FartyPants / the_muse
  oobabooga extension - Experimental sampler to make LLMs more creative
  ☆23Updated last year
• dibrale / webui_autonomics
  Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.
  ☆35Updated last year
• Trojaner / text-generation-webui-stable_diffusion
  Integrate image generation capabilities to text-generation-webui using Stable Diffusion.
  ☆55Updated 11 months ago
• minemo / text-generation-webui-barktts
  A simple extension that uses Bark Text-to-Speech for audio output
  ☆35Updated last year
• hallucinate-games / oobabooga-jsonformer-plugin
  This plugin forces models to output JSON of a specified schema using JSONFormer
  ☆27Updated 5 months ago
• theubie / simple_memory
  An extension to Oobabooga to add a simple memory function for chat
  ☆25Updated last year
• SicariusSicariiStuff / Diffusion_TTS
  Diffusion_TTS extension for booga
  ☆67Updated 10 months ago
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆109Updated 6 months ago
• jllllll / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆25Updated last year
• oobabooga / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆23Updated last month
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• acpopescu / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆44Updated last year
• RandomInternetPreson / Lucid_Vision
  This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…
  ☆53Updated 6 months ago
• danikhan632 / guidance_api
  An Extension for oobabooga/text-generation-webui
  ☆36Updated last year
• FartyPants / StoryCrafter
  Writing Extension for Text Generation WebUI
  ☆54Updated 3 months ago
• DavG25 / text-generation-webui-code_syntax_highlight
  An extension for oobabooga's text-generation-webui that adds syntax highlighting to code snippets
  ☆67Updated 11 months ago
• FartyPants / Training_PRO
  Traing PRO extension for oobabooga WebUI - recent dev version
  ☆49Updated 3 months ago
• ClayShoaf / oobabooga-one-click-bandaid
  A simple batch file to make the oobabooga one click installer compatible with llama 4bit models and able to run on cuda
  ☆21Updated 2 years ago
• oobabooga / flash-attention
  Fast and memory-efficient exact attention - Windows wheels
  ☆38Updated last week
• flotos / Game-Shaper-AI
  Interact with a AI Game-engine that keep building its rules and world as you play, adapted to your gameplay.
  ☆43Updated this week
• p-e-w / chatbot_clinic
  Science-driven chatbot development
  ☆57Updated last year
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated last year
• FartyPants / Playground
  Text WebUI extension to add clever Notebooks to Chat mode
  ☆139Updated last year
• SkinnyDevi / webui_tavernai_charas
  A TavernUI Character extension for oobabooga's Text Generation WebUI
  ☆65Updated this week
• theroyallab / ST-tabbyAPI-loader
  Loader extension for tabbyAPI in SillyTavern
  ☆25Updated 9 months ago