Alternatives and similar repositories for flash-attention

Users that are interested in flash-attention are comparing it to the libraries listed below

• Trojaner / text-generation-webui-stable_diffusion
  Integrate image generation capabilities to text-generation-webui using Stable Diffusion.
  ☆56Updated last year
• ThereforeGames / echoproof
  Simple extension for text-generation-webui that injects recent conversation history into the negative prompt with the goal of minimizing …
  ☆31Updated 2 years ago
• RandomInternetPreson / LucidWebSearch
  A web search extension for Oobabooga's text-generation-webui (now with nougat)
  ☆73Updated last year
• SicariusSicariiStuff / Diffusion_TTS
  Diffusion_TTS extension for booga
  ☆68Updated 2 months ago
• ill13 / SpeakLocal
  A TTS extension for oobabooga text WebUI
  ☆31Updated last year
• dibrale / webui_autonomics
  Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.
  ☆34Updated 2 years ago
• theubie / simple_memory
  An extension to Oobabooga to add a simple memory function for chat
  ☆25Updated 2 years ago
• jllllll / GPTQ-for-LLaMa-CUDA
  A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.
  ☆22Updated 2 years ago
• p-e-w / chatbot_clinic
  Science-driven chatbot development
  ☆60Updated last year
• kanttouchthis / text_generation_webui_xtts
  XTTSv2 Extension for oobabooga text-generation-webui
  ☆154Updated 2 years ago
• FartyPants / FPreloader
  Hard Reload oobabooga text WebUI extensions
  ☆19Updated 10 months ago
• ouoertheo / silero-api-server
  ☆71Updated 3 months ago
• hallucinate-games / oobabooga-jsonformer-plugin
  This plugin forces models to output JSON of a specified schema using JSONFormer
  ☆28Updated last year
• RandomInternetPreson / Lucid_Vision
  This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…
  ☆57Updated last year
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆108Updated last year
• FartyPants / the_muse
  oobabooga extension - Experimental sampler to make LLMs more creative
  ☆22Updated 2 years ago
• FartyPants / Training_PRO
  Traing PRO extension for oobabooga WebUI - recent dev version
  ☆52Updated 3 months ago
• cocktailpeanut / hallucinator
  ☆50Updated last year
• Anglebrackets / web_rag
  Oobabooga Text-Gen Web UI extension: get web content, add to context
  ☆23Updated last year
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆53Updated last year
• oobabooga / flash-attention
  Fast and memory-efficient exact attention - Windows wheels
  ☆36Updated 6 months ago
• FartyPants / StoryCrafter
  Writing Extension for Text Generation WebUI
  ☆64Updated 3 months ago
• minemo / text-generation-webui-barktts
  A simple extension that uses Bark Text-to-Speech for audio output
  ☆33Updated 2 years ago
• ill13 / AutoSave
  An auto save extension for text generated with the oobabooga WebUI
  ☆25Updated last month
• shinomakoi / magi_llm_gui
  A Qt GUI for large language models
  ☆44Updated 2 years ago
• DavG25 / text-generation-webui-code_syntax_highlight
  An extension for oobabooga's text-generation-webui that adds syntax highlighting to code snippets
  ☆66Updated last year
• wsippel / bark_tts
  Oobabooga extension for Bark TTS
  ☆119Updated 2 years ago
• oobabooga / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆27Updated 7 months ago
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated last year
• FaceDeer / storyteller
  A simple framework for using a local Koboldcpp LLM to help with story-writing
  ☆24Updated last year