Alternatives and similar repositories for GPTQ-for-LLaMa-ROCm

Users that are interested in GPTQ-for-LLaMa-ROCm are comparing it to the libraries listed below

• evshiron / rocm_lab
  DEPRECATED!
  ☆51Updated last year
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆513Updated 7 months ago
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆210Updated last week
• johnsmith0031 / alpaca_lora_4bit
  ☆535Updated last year
• agrocylo / bitsandbytes-rocm
  8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs
  ☆51Updated 2 years ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆247Updated last year
• AlpinDale / gptslop
  A community list of common phrases generated by GPT and Claude models
  ☆78Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆187Updated last year
• broncotc / bitsandbytes-rocm
  ☆37Updated 2 years ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆124Updated 2 years ago
• JingShing / How-to-use-tesla-p40
  A manual for helping using tesla p40 gpu
  ☆130Updated 10 months ago
• ParisNeo / lollms_legacy
  Lord of LLMS
  ☆294Updated this week
• wawawario2 / long_term_memory
  A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.
  ☆309Updated 2 years ago
• TheBlokeAI / dockerLLM
  TheBloke's Dockerfiles
  ☆307Updated last year
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆110Updated 2 years ago
• 0cc4m / KoboldAI
  ☆158Updated last year
• kaiokendev / superbig
  A prompt/context management system
  ☆170Updated 2 years ago
• AlpinDale / sparsegpt-for-LLaMA
  Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.
  ☆71Updated 2 years ago
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆216Updated last year
• bartowski1182 / koboldcpp-docker
  Docker configuration for koboldcpp
  ☆36Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆129Updated 2 years ago
• arlo-phoenix / bitsandbytes-rocm-5.6
  8-bit CUDA functions for PyTorch Rocm compatible
  ☆41Updated last year
• flurb18 / AgentOoba
  An autonomous AI agent extension for Oobabooga's web ui
  ☆176Updated 2 years ago
• Ph0rk0z / text-generation-webui-testing
  A fork of textgen that kept some things like Exllama and old GPTQ.
  ☆22Updated last year
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆1,057Updated last month
• iaalm / llama-api-server
  A OpenAI API compatible REST server for llama.
  ☆208Updated 7 months ago
• RedTopper / Text-Generation-Webui-Podman
  Generate Large Language Model text in a container.
  ☆20Updated 2 years ago
• daniandtheweb / sd.cpp-webui
  A simple webui for stable-diffusion.cpp
  ☆40Updated this week
• Gryphe / BlockMerge_Gradient
  Merge Transformers language models by use of gradient parameters.
  ☆208Updated last year