Alternatives and similar repositories for flash-attention

Users that are interested in flash-attention are comparing it to the libraries listed below

• ThereforeGames / echoproof
  Simple extension for text-generation-webui that injects recent conversation history into the negative prompt with the goal of minimizing …
  ☆33Updated last year
• Trojaner / text-generation-webui-stable_diffusion
  Integrate image generation capabilities to text-generation-webui using Stable Diffusion.
  ☆55Updated last year
• SicariusSicariiStuff / Diffusion_TTS
  Diffusion_TTS extension for booga
  ☆67Updated last year
• ill13 / SpeakLocal
  A TTS extension for oobabooga text WebUI
  ☆32Updated last year
• RandomInternetPreson / LucidWebSearch
  A web search extension for Oobabooga's text-generation-webui (now with nougat)
  ☆74Updated 11 months ago
• FartyPants / FPreloader
  Hard Reload oobabooga text WebUI extensions
  ☆18Updated 5 months ago
• theubie / simple_memory
  An extension to Oobabooga to add a simple memory function for chat
  ☆25Updated 2 years ago
• jllllll / GPTQ-for-LLaMa-CUDA
  A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.
  ☆22Updated last year
• SkinnyDevi / webui_tavernai_charas
  A TavernUI Character extension for oobabooga's Text Generation WebUI
  ☆66Updated last month
• oobabooga / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆25Updated 2 months ago
• oobabooga / flash-attention
  Fast and memory-efficient exact attention - Windows wheels
  ☆38Updated last month
• minemo / text-generation-webui-barktts
  A simple extension that uses Bark Text-to-Speech for audio output
  ☆34Updated last year
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated last year
• Electrofried / ComfyUI-OpenAINode
  This is a simple node for comfyUI that accesses any openAI API server the user specifies and enables simple text generation with a string…
  ☆28Updated last year
• dibrale / webui_autonomics
  Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.
  ☆35Updated last year
• rsxdalv / chatterbox
  SoTA open-source TTS
  ☆22Updated this week
• jllllll / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆25Updated last year
• janvarev / multi_translate
  Plugin for oobabooga/text-generation-webui - translation plugin with multi engines
  ☆27Updated 2 years ago
• camenduru / TokenFlow-colab
  ☆22Updated last year
• Anglebrackets / web_rag
  Oobabooga Text-Gen Web UI extension: get web content, add to context
  ☆21Updated last year
• FizzleDorf / AIT
  This was orginally written by: https://github.com/hlky
  ☆49Updated last year
• deepghs / hfutils
  Useful utilities for huggingface
  ☆22Updated last month
• FartyPants / the_muse
  oobabooga extension - Experimental sampler to make LLMs more creative
  ☆23Updated last year
• Nick088Official / SuperPrompt-v1
  Makes your prompts better both Locally & Online, UI & NO UI
  ☆42Updated 7 months ago
• aria1th / sd-webui-deepcache-standalone
  ☆32Updated 11 months ago
• kanttouchthis / text_generation_webui_xtts
  XTTSv2 Extension for oobabooga text-generation-webui
  ☆154Updated last year
• ouoertheo / silero-api-server
  ☆69Updated 8 months ago
• FartyPants / StoryCrafter
  Writing Extension for Text Generation WebUI
  ☆60Updated 5 months ago
• p-e-w / chatbot_clinic
  Science-driven chatbot development
  ☆57Updated last year
• FaceDeer / storyteller
  A simple framework for using a local Koboldcpp LLM to help with story-writing
  ☆21Updated last year