Alternatives and similar repositories for GPTQ-for-LLaMa-Wheels:

Users that are interested in GPTQ-for-LLaMa-Wheels are comparing it to the libraries listed below

• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆108Updated 5 months ago
• jllllll / GPTQ-for-LLaMa-CUDA
  A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.
  ☆22Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• 0cc4m / GPTQ-for-LLaMa
  4 bits quantization of LLMs using GPTQ
  ☆49Updated last year
• wsippel / bark_tts
  Oobabooga extension for Bark TTS
  ☆118Updated last year
• CoffeeVampir3 / ez-trainer
  Train Llama Loras Easily
  ☆31Updated last year
• s4rduk4r / alpaca_lora_4bit_readme
  Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit
  ☆31Updated last year
• FartyPants / the_muse
  oobabooga extension - Experimental sampler to make LLMs more creative
  ☆23Updated last year
• minemo / text-generation-webui-barktts
  A simple extension that uses Bark Text-to-Speech for audio output
  ☆35Updated last year
• acpopescu / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆44Updated last year
• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆130Updated last year
• FartyPants / Training_PRO
  Traing PRO extension for oobabooga WebUI - recent dev version
  ☆48Updated 3 months ago
• FartyPants / Playground
  Text WebUI extension to add clever Notebooks to Chat mode
  ☆139Updated last year
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated last year
• Silver267 / pytorch-to-safetensor-converter
  A simple converter which converts pytorch bin files to safetensor, intended to be used for LLM conversion.
  ☆65Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆46Updated last year
• wawawario2 / long_term_memory
  A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.
  ☆310Updated last year
• jllllll / flash-attention
  Fast and memory-efficient exact attention - Windows wheels
  ☆33Updated last year
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated 2 years ago
• AlpinDale / RPTQ-for-LLaMA
  Efficient 3bit/4bit quantization of LLaMA models
  ☆19Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• KohakuBlueleaf / guanaco-lora
  Instruct-tune LLaMA on consumer hardware
  ☆74Updated last year
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated last year
• YenRaven / annoy_ltm
  annoy long term memory experiment for oobabooga/text-generation-webui
  ☆31Updated last year
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated 11 months ago
• hizkifw / WebChatRWKVstic
  ChatGPT-like Web UI for RWKVstic
  ☆100Updated 2 years ago
• kanttouchthis / text_generation_webui_xtts
  XTTSv2 Extension for oobabooga text-generation-webui
  ☆152Updated last year
• Orion-zhen / abliteration
  Make abliterated models with transformers, easy and fast
  ☆67Updated last week