Alternatives and similar repositories for AutoGPTQ

Users that are interested in AutoGPTQ are comparing it to the libraries listed below

• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆122Updated last year
• ChobPT / oobaboogas-webui-langchain_agent
  Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work
  ☆73Updated last year
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆36Updated last year
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆104Updated last year
• Dhaladom / TALIS
  Simple and fast server for GPTQ-quantized LLaMA inference
  ☆24Updated 2 years ago
• cognitivecomputations / OpenChatML
  ☆157Updated 10 months ago
• aspctu / alpaca-lora
  Instruct-tuning LLaMA on consumer hardware
  ☆65Updated 2 years ago
• dibrale / webui_autonomics
  Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.
  ☆34Updated last year
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆78Updated last year
• iwalton3 / mpt-lora-patch
  Patch for MPT-7B which allows using and training a LoRA
  ☆58Updated 2 years ago
• mzbac / AutoGPTQ-API
  Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
  ☆90Updated last year
• DataBassGit / BabyBoogaAGI
  Porting BabyAGI to Oobabooba.
  ☆30Updated last year
• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆129Updated 2 years ago
• emrgnt-cmplxty / zero-shot-replication
  ☆72Updated last year
• teknium1 / ShareGPT-Builder
  ☆114Updated 5 months ago
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆147Updated last year
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆109Updated 7 months ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆63Updated last year
• frapastique / frapuse-ai-companion-android-app
  This repository represents my final assignment of "Module 3 - Android App Development" at Syntax Institut.
  ☆28Updated last year
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆161Updated last year
• kyegomez / Andromeda
  An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast
  ☆147Updated 9 months ago
• cognitivecomputations / kraken
  ☆66Updated last year
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆27Updated last year
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆238Updated last year
• danikhan632 / guidance_api
  An Extension for oobabooga/text-generation-webui
  ☆36Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• PygmalionAI / training-code
  The code we currently use to fine-tune models.
  ☆113Updated last year
• Aspartame-e951 / apiserver.py
  A small standalone flask python server for llama.cpp that acts like a KoboldAI api.
  ☆14Updated 2 years ago
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆32Updated last year
• teknium1 / alpaca-roleplay-discordbot
  A discord bot that roleplays!
  ☆149Updated last year