Alternatives and similar repositories for flash-attention:

Users that are interested in flash-attention are comparing it to the libraries listed below

• ThereforeGames / echoproof
  Simple extension for text-generation-webui that injects recent conversation history into the negative prompt with the goal of minimizing …
  ☆33Updated last year
• SicariusSicariiStuff / Diffusion_TTS
  Diffusion_TTS extension for booga
  ☆67Updated 9 months ago
• Trojaner / text-generation-webui-stable_diffusion
  Integrate image generation capabilities to text-generation-webui using Stable Diffusion.
  ☆54Updated 10 months ago
• ill13 / SpeakLocal
  A TTS extension for oobabooga text WebUI
  ☆30Updated 10 months ago
• jllllll / GPTQ-for-LLaMa-CUDA
  A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.
  ☆22Updated last year
• theubie / simple_memory
  An extension to Oobabooga to add a simple memory function for chat
  ☆24Updated last year
• RandomInternetPreson / LucidWebSearch
  A web search extension for Oobabooga's text-generation-webui (now with nougat)
  ☆74Updated 8 months ago
• dibrale / webui_autonomics
  Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.
  ☆35Updated last year
• FartyPants / Playground
  Text WebUI extension to add clever Notebooks to Chat mode
  ☆139Updated last year
• LAION-AI / Desktop_BUD-E
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆32Updated 8 months ago
• FartyPants / FPreloader
  Hard Reload oobabooga text WebUI extensions
  ☆17Updated 2 months ago
• oobabooga / flash-attention
  Fast and memory-efficient exact attention - Windows wheels
  ☆38Updated last month
• xanthousm / text-gen-webui-ui_tweaks
  An extension for text-generation-webui by oobabooga. Adds options to keep tabs on page and to move extensions into a sidebar.
  ☆23Updated last year
• SkinnyDevi / webui_tavernai_charas
  A TavernUI Character extension for oobabooga's Text Generation WebUI
  ☆64Updated 9 months ago
• danikhan632 / guidance_api
  An Extension for oobabooga/text-generation-webui
  ☆36Updated last year
• FartyPants / the_muse
  oobabooga extension - Experimental sampler to make LLMs more creative
  ☆23Updated last year
• BuffMcBigHuge / text-generation-webui-edge-tts
  A very simple implementation of edge_tts w/ RVC for oobabooga text-generation-webui.
  ☆41Updated last year
• jllllll / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆25Updated last year
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆108Updated 5 months ago
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated last year
• minemo / text-generation-webui-barktts
  A simple extension that uses Bark Text-to-Speech for audio output
  ☆35Updated last year
• p-e-w / chatbot_clinic
  Science-driven chatbot development
  ☆56Updated 10 months ago
• camenduru / TokenFlow-colab
  ☆22Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• hallucinate-games / oobabooga-jsonformer-plugin
  This plugin forces models to output JSON of a specified schema using JSONFormer
  ☆27Updated 4 months ago
• kanttouchthis / text_generation_webui_xtts
  XTTSv2 Extension for oobabooga text-generation-webui
  ☆152Updated last year
• Skquark / AI-Friends
  A collection of handy helpers for AI art generation, AI writing and other experimental tools
  ☆50Updated 5 months ago
• ClayShoaf / oobabooga-one-click-bandaid
  A simple batch file to make the oobabooga one click installer compatible with llama 4bit models and able to run on cuda
  ☆21Updated 2 years ago
• FaceDeer / storyteller
  A simple framework for using a local Koboldcpp LLM to help with story-writing
  ☆21Updated last year
• Dartvauder / NeuroSandboxWebUI
  (Windows/Linux/MacOS) Local WebUI with neural network models (Text, Image, Video, 3D, Audio) on python (Gradio interface). Translated on …
  ☆94Updated this week