Alternatives and similar repositories for GPTQ-for-LLaMa-Wheels

Users that are interested in GPTQ-for-LLaMa-Wheels are comparing it to the libraries listed below

• wawawario2 / long_term_memory
  A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.
  ☆310Updated 2 years ago
• jllllll / bitsandbytes-windows-webui
  Windows compile of bitsandbytes for use in text-generation-webui.
  ☆363Updated 2 years ago
• wsippel / bark_tts
  Oobabooga extension for Bark TTS
  ☆120Updated 2 years ago
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆108Updated last year
• Ph0rk0z / text-generation-webui-testing
  A fork of textgen that kept some things like Exllama and old GPTQ.
  ☆22Updated last year
• 0cc4m / KoboldAI
  ☆156Updated 2 years ago
• GiusTex / EdgeGPT
  Extension for Text Generation Webui based on EdgeGPT, a reverse engineered API of Microsoft's Bing Chat AI
  ☆124Updated 2 years ago
• FartyPants / Playground
  Text WebUI extension to add clever Notebooks to Chat mode
  ☆145Updated 5 months ago
• ClayShoaf / oobabooga-one-click-bandaid
  A simple batch file to make the oobabooga one click installer compatible with llama 4bit models and able to run on cuda
  ☆21Updated 2 years ago
• Keith-Hon / bitsandbytes-windows
  8-bit CUDA functions for PyTorch in Windows 10
  ☆68Updated 2 years ago
• sdbds / audiocraft-webui
  ☆49Updated 2 years ago
• DavG25 / text-generation-webui-code_syntax_highlight
  An extension for oobabooga's text-generation-webui that adds syntax highlighting to code snippets
  ☆69Updated last year
• s4rduk4r / alpaca_lora_4bit_readme
  Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit
  ☆32Updated 2 years ago
• acpopescu / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆42Updated 2 years ago
• Fictiverse / bark
  🔊 Text-prompted Generative Audio Model
  ☆236Updated 2 years ago
• kanttouchthis / text_generation_webui_xtts
  XTTSv2 Extension for oobabooga text-generation-webui
  ☆156Updated 2 years ago
• james-things / bitsandbytes-prebuilt-all_arch
  A repository containing prebuilt versions of the bitsandbytes library for Windows
  ☆40Updated 2 years ago
• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆131Updated 2 years ago
• 0cc4m / GPTQ-for-LLaMa
  4 bits quantization of LLMs using GPTQ
  ☆49Updated 2 years ago
• iantbutler01 / rwkv-raven-qlora-4bit-instruct
  A finetuning pipeline for instruct tuning Raven 14bn using QLORA 4bit and the Ditty finetuning library
  ☆28Updated last year
• flurb18 / AgentOoba
  An autonomous AI agent extension for Oobabooga's web ui
  ☆173Updated 2 years ago
• jllllll / one-click-installers
  Simplified installers for oobabooga/text-generation-webui.
  ☆53Updated 2 years ago
• jllllll / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆100Updated last year
• DeXtmL / bitsandbytes-win-prebuilt
  ☆76Updated 3 years ago
• flurb18 / babyagi4all-api
  BabyAGI to run with locally hosted models using the API from https://github.com/oobabooga/text-generation-webui
  ☆87Updated 2 years ago
• rupeshs / diffusionmagic
  Easy to use Stable diffusion workflows using diffusers
  ☆125Updated 5 months ago
• AlpinDale / pygmalion.cpp
  C/C++ implementation of PygmalionAI/pygmalion-6b
  ☆56Updated 2 years ago
• AUTOMATIC1111 / stable-diffusion-webui-tensorrt
  ☆316Updated 2 years ago
• Blealtan / RWKV-LM-LoRA
  RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …
  ☆412Updated 2 years ago
• Nexesenex / croco.cpp
  Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…
  ☆153Updated this week