Alternatives and similar repositories for GPTQ-for-LLaMa-CUDA

Users that are interested in GPTQ-for-LLaMa-CUDA are comparing it to the libraries listed below

• ThereforeGames / echoproof
  Simple extension for text-generation-webui that injects recent conversation history into the negative prompt with the goal of minimizing …
  ☆33Updated last year
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• p-e-w / chatbot_clinic
  Science-driven chatbot development
  ☆58Updated last year
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated last year
• jllllll / flash-attention
  Fast and memory-efficient exact attention - Windows wheels
  ☆33Updated last year
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆108Updated 8 months ago
• AUTOMATIC1111 / llm-political-compass
  Web page with political compass quiz results for open LLMs
  ☆37Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• theubie / simple_memory
  An extension to Oobabooga to add a simple memory function for chat
  ☆25Updated 2 years ago
• jllllll / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆97Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated last year
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated last year
• dibrale / webui_autonomics
  Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.
  ☆35Updated last year
• FishiaTee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 6 months ago
• shinomakoi / magi_llm_gui
  A Qt GUI for large language models
  ☆43Updated last year
• RandomInternetPreson / LucidWebSearch
  A web search extension for Oobabooga's text-generation-webui (now with nougat)
  ☆74Updated last year
• s4rduk4r / alpaca_lora_4bit_readme
  Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit
  ☆31Updated 2 years ago
• YenRaven / annoy_ltm
  annoy long term memory experiment for oobabooga/text-generation-webui
  ☆31Updated last year
• DavG25 / text-generation-webui-code_syntax_highlight
  An extension for oobabooga's text-generation-webui that adds syntax highlighting to code snippets
  ☆68Updated last year
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• ChobPT / oobaboogas-webui-langchain_agent
  Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work
  ☆74Updated last year
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• Anglebrackets / web_rag
  Oobabooga Text-Gen Web UI extension: get web content, add to context
  ☆21Updated last year
• matatonic / openedai-images
  An OpenAI API compatible images server to generate or manipulate images.
  ☆16Updated 5 months ago
• nydasco / jen-ai
  A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.
  ☆45Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• Trojaner / text-generation-webui-stable_diffusion
  Integrate image generation capabilities to text-generation-webui using Stable Diffusion.
  ☆55Updated last year
• dmatora / LLM-inference-speed-benchmarks
  ☆18Updated 9 months ago
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• arthurwolf / llmi
  Large-Language-Model to Machine Interface project.
  ☆19Updated last year