Alternatives and similar repositories for GPTQ-for-LLaMa-CUDA:

Users that are interested in GPTQ-for-LLaMa-CUDA are comparing it to the libraries listed below

• ThereforeGames / echoproof
  Simple extension for text-generation-webui that injects recent conversation history into the negative prompt with the goal of minimizing …
  ☆33Updated last year
• theubie / simple_memory
  An extension to Oobabooga to add a simple memory function for chat
  ☆24Updated last year
• xanthousm / text-gen-webui-ui_tweaks
  An extension for text-generation-webui by oobabooga. Adds options to keep tabs on page and to move extensions into a sidebar.
  ☆22Updated last year
• ill13 / SpeakLocal
  A TTS extension for oobabooga text WebUI
  ☆30Updated 10 months ago
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆108Updated 4 months ago
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated last year
• dibrale / webui_autonomics
  Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.
  ☆35Updated last year
• arthurwolf / llmi
  Large-Language-Model to Machine Interface project.
  ☆18Updated last year
• oobabooga / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆21Updated last week
• Anglebrackets / web_rag
  Oobabooga Text-Gen Web UI extension: get web content, add to context
  ☆21Updated 9 months ago
• FartyPants / the_muse
  oobabooga extension - Experimental sampler to make LLMs more creative
  ☆23Updated last year
• p-e-w / chatbot_clinic
  Science-driven chatbot development
  ☆56Updated 10 months ago
• jllllll / flash-attention
  Fast and memory-efficient exact attention - Windows wheels
  ☆33Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• jabberjabberjabber / Chunkify
  Create text chunks which end at natural stopping points without using a tokenizer
  ☆26Updated last week
• stringandstickytape / MaxsAiStudio
  A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.
  ☆29Updated this week
• TheLocalLab / text-generation-webui-simple-colab
  A simple updated colab doc that will allow you to run the Ooba Booga Text-Generation-Webui for free with just a few lines of codes.
  ☆23Updated 5 months ago
• theroyallab / ST-tabbyAPI-loader
  Loader extension for tabbyAPI in SillyTavern
  ☆25Updated 7 months ago
• shinomakoi / magi_llm_gui
  A Qt GUI for large language models
  ☆42Updated last year
• theroyallab / llm-prompt-templates
  Prompt Jinja2 templates for LLMs
  ☆30Updated 2 months ago
• HabermannR / Fantasy-Tribe-Game
  LLM backed Fantasy Tribe Game
  ☆18Updated 4 months ago
• DavG25 / text-generation-webui-code_syntax_highlight
  An extension for oobabooga's text-generation-webui that adds syntax highlighting to code snippets
  ☆66Updated 9 months ago
• RandomInternetPreson / LucidWebSearch
  A web search extension for Oobabooga's text-generation-webui (now with nougat)
  ☆74Updated 8 months ago
• FishiaT / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆11Updated 2 months ago
• Trojaner / text-generation-webui-stable_diffusion
  Integrate image generation capabilities to text-generation-webui using Stable Diffusion.
  ☆54Updated 10 months ago
• YenRaven / annoy_ltm
  annoy long term memory experiment for oobabooga/text-generation-webui
  ☆31Updated last year
• KirillRepinArt / ChatGPT-UI
  ChatGPT CSS style
  ☆12Updated 10 months ago
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated 9 months ago
• SicariusSicariiStuff / Diffusion_TTS
  Diffusion_TTS extension for booga
  ☆66Updated 9 months ago