Alternatives and similar repositories for GPTQ-for-LLaMa-Wheels

Users that are interested in GPTQ-for-LLaMa-Wheels are comparing it to the libraries listed below

• wawawario2 / long_term_memory
  A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.
  ☆308Updated 2 years ago
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆107Updated 11 months ago
• wsippel / bark_tts
  Oobabooga extension for Bark TTS
  ☆118Updated last year
• jllllll / bitsandbytes-windows-webui
  Windows compile of bitsandbytes for use in text-generation-webui.
  ☆359Updated last year
• GiusTex / EdgeGPT
  Extension for Text Generation Webui based on EdgeGPT, a reverse engineered API of Microsoft's Bing Chat AI
  ☆123Updated 2 years ago
• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆130Updated 2 years ago
• Keith-Hon / bitsandbytes-windows
  8-bit CUDA functions for PyTorch in Windows 10
  ☆68Updated 2 years ago
• ClayShoaf / oobabooga-one-click-bandaid
  A simple batch file to make the oobabooga one click installer compatible with llama 4bit models and able to run on cuda
  ☆20Updated 2 years ago
• s4rduk4r / alpaca_lora_4bit_readme
  Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit
  ☆31Updated 2 years ago
• james-things / bitsandbytes-prebuilt-all_arch
  A repository containing prebuilt versions of the bitsandbytes library for Windows
  ☆39Updated 2 years ago
• kanttouchthis / text_generation_webui_xtts
  XTTSv2 Extension for oobabooga text-generation-webui
  ☆154Updated last year
• acpopescu / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆41Updated 2 years ago
• FartyPants / Playground
  Text WebUI extension to add clever Notebooks to Chat mode
  ☆144Updated 2 months ago
• DavG25 / text-generation-webui-code_syntax_highlight
  An extension for oobabooga's text-generation-webui that adds syntax highlighting to code snippets
  ☆66Updated last year
• 0cc4m / KoboldAI
  ☆158Updated 2 years ago
• danikhan632 / guidance_api
  An Extension for oobabooga/text-generation-webui
  ☆36Updated 2 years ago
• 0cc4m / GPTQ-for-LLaMa
  4 bits quantization of LLMs using GPTQ
  ☆49Updated 2 years ago
• Ph0rk0z / text-generation-webui-testing
  A fork of textgen that kept some things like Exllama and old GPTQ.
  ☆22Updated last year
• johnsmith0031 / alpaca_lora_4bit
  ☆534Updated last year
• YenRaven / annoy_ltm
  annoy long term memory experiment for oobabooga/text-generation-webui
  ☆30Updated 2 years ago
• jllllll / one-click-installers
  Simplified installers for oobabooga/text-generation-webui.
  ☆53Updated 2 years ago
• janvarev / multi_translate
  Plugin for oobabooga/text-generation-webui - translation plugin with multi engines
  ☆27Updated 2 years ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆247Updated last year
• sebaxzero / LangChain_PDFChat_Oobabooga
  oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local
  ☆70Updated 2 years ago
• Blealtan / RWKV-LM-LoRA
  RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …
  ☆412Updated 2 years ago
• flurb18 / AgentOoba
  An autonomous AI agent extension for Oobabooga's web ui
  ☆173Updated 2 years ago
• jllllll / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆97Updated last year
• ouoertheo / silero-api-server
  ☆71Updated 2 months ago
• minemo / text-generation-webui-barktts
  A simple extension that uses Bark Text-to-Speech for audio output
  ☆33Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated 2 years ago