Alternatives and similar repositories for GPTQ-for-LLaMa-ROCm

Users that are interested in GPTQ-for-LLaMa-ROCm are comparing it to the libraries listed below

• evshiron / rocm_lab
  DEPRECATED!
  ☆50Updated last year
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆514Updated 10 months ago
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆216Updated 2 weeks ago
• Ph0rk0z / text-generation-webui-testing
  A fork of textgen that kept some things like Exllama and old GPTQ.
  ☆22Updated last year
• xor2k / gpu_undervolt
  ☆48Updated 2 years ago
• mamei16 / LLM_Web_search
  An extension for oobabooga/text-generation-webui that enables the LLM to search the web
  ☆271Updated 3 weeks ago
• bartowski1182 / koboldcpp-docker
  Docker configuration for koboldcpp
  ☆40Updated last year
• 0cc4m / KoboldAI
  ☆157Updated 2 years ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆124Updated 2 years ago
• JingShing / How-to-use-tesla-p40
  A manual for helping using tesla p40 gpu
  ☆139Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆248Updated last year
• johnsmith0031 / alpaca_lora_4bit
  ☆535Updated 2 years ago
• flurb18 / AgentOoba
  An autonomous AI agent extension for Oobabooga's web ui
  ☆173Updated 2 years ago
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆108Updated last year
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆109Updated 2 years ago
• jllllll / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆99Updated last year
• wawawario2 / long_term_memory
  A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.
  ☆309Updated 2 years ago
• kaiokendev / superbig
  A prompt/context management system
  ☆170Updated 2 years ago
• RedTopper / Text-Generation-Webui-Podman
  Generate Large Language Model text in a container.
  ☆20Updated 2 years ago
• ChobPT / oobaboogas-webui-langchain_agent
  Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work
  ☆74Updated 2 years ago
• ghostpad / ghostpad
  A free AI text generation interface based on KoboldAI
  ☆33Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated 2 years ago
• agrocylo / bitsandbytes-rocm
  8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs
  ☆51Updated 2 years ago
• TheBlokeAI / dockerLLM
  TheBloke's Dockerfiles
  ☆308Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆130Updated 2 years ago
• c0sogi / llama-api
  An OpenAI-like LLaMA inference API
  ☆113Updated 2 years ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆189Updated last year
• theroyallab / tabbyAPI-gradio-loader
  A simple Gradio WebUI for loading/unloading models and loras in tabbyAPI.
  ☆20Updated last year
• broncotc / bitsandbytes-rocm
  ☆37Updated 2 years ago
• AlpinDale / gptslop
  A community list of common phrases generated by GPT and Claude models
  ☆79Updated 2 years ago