Alternatives and similar repositories for GPTQ-for-LLaMa-CUDA:

Users that are interested in GPTQ-for-LLaMa-CUDA are comparing it to the libraries listed below

• ThereforeGames / echoproof
  Simple extension for text-generation-webui that injects recent conversation history into the negative prompt with the goal of minimizing …
  ☆33Updated last year
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• Anglebrackets / web_rag
  Oobabooga Text-Gen Web UI extension: get web content, add to context
  ☆20Updated 8 months ago
• theubie / simple_memory
  An extension to Oobabooga to add a simple memory function for chat
  ☆23Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• HabermannR / Fantasy-Tribe-Game
  LLM backed Fantasy Tribe Game
  ☆18Updated 2 months ago
• xanthousm / text-gen-webui-ui_tweaks
  An extension for text-generation-webui by oobabooga. Adds options to keep tabs on page and to move extensions into a sidebar.
  ☆22Updated last year
• FartyPants / the_muse
  oobabooga extension - Experimental sampler to make LLMs more creative
  ☆23Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year
• shinomakoi / magi_llm_gui
  A Qt GUI for large language models
  ☆41Updated last year
• jason-brian-anderson / long_term_memory_with_qdrant
  RAG implementation for Ooba characters. dynamically spins up new qdrant vector DB and manages retrieval and commits for conversations ba…
  ☆46Updated last year
• theroyallab / ST-tabbyAPI-loader
  Loader extension for tabbyAPI in SillyTavern
  ☆25Updated 6 months ago
• jabberjabberjabber / Chunkify
  Create text chunks which end at natural stopping points without using a tokenizer
  ☆26Updated 2 months ago
• RandomInternetPreson / LucidWebSearch
  A web search extension for Oobabooga's text-generation-webui (now with nougat)
  ☆71Updated 7 months ago
• stringandstickytape / MaxsAiStudio
  A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.
  ☆29Updated this week
• p-e-w / chatbot_clinic
  Science-driven chatbot development
  ☆56Updated 9 months ago
• Trojaner / text-generation-webui-stable_diffusion
  Integrate image generation capabilities to text-generation-webui using Stable Diffusion.
  ☆53Updated 9 months ago
• FishiaT / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆11Updated last month
• LAION-AI / Desktop_BUD-E
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆31Updated 7 months ago
• dibrale / webui_autonomics
  Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.
  ☆34Updated last year
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆107Updated 3 months ago
• jllllll / flash-attention
  Fast and memory-efficient exact attention - Windows wheels
  ☆32Updated 11 months ago
• ill13 / SpeakLocal
  A TTS extension for oobabooga text WebUI
  ☆29Updated 9 months ago
• KirillRepinArt / ChatGPT-UI
  ChatGPT CSS style
  ☆12Updated 9 months ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• s4rduk4r / alpaca_lora_4bit_readme
  Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit
  ☆31Updated last year
• YenRaven / annoy_ltm
  annoy long term memory experiment for oobabooga/text-generation-webui
  ☆31Updated last year
• rodrigobaron / anthill
  ☆24Updated 3 weeks ago
• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆43Updated 10 months ago
• oobabooga / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆21Updated last month