Alternatives and similar repositories for GPTQ-for-LLaMa-ROCm

Users that are interested in GPTQ-for-LLaMa-ROCm are comparing it to the libraries listed below

• evshiron / rocm_lab
  DEPRECATED!
  ☆50Updated last year
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆216Updated last month
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆514Updated 10 months ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆248Updated last year
• eliranwong / MultiAMDGPU_AIDev_Ubuntu
  Multi AMD GPU Setup for AI Development on Ubuntu with ROCM
  ☆43Updated 2 months ago
• kaiokendev / superbig
  A prompt/context management system
  ☆170Updated 2 years ago
• Ph0rk0z / text-generation-webui-testing
  A fork of textgen that kept some things like Exllama and old GPTQ.
  ☆22Updated last year
• flurb18 / AgentOoba
  An autonomous AI agent extension for Oobabooga's web ui
  ☆173Updated 2 years ago
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆109Updated 2 years ago
• ParisNeo / lollms_legacy
  Lord of LLMS
  ☆293Updated 3 months ago
• 0cc4m / KoboldAI
  ☆157Updated 2 years ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆124Updated 2 years ago
• mamei16 / LLM_Web_search
  An extension for oobabooga/text-generation-webui that enables the LLM to search the web
  ☆274Updated last month
• wawawario2 / long_term_memory
  A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.
  ☆309Updated 2 years ago
• TheBlokeAI / dockerLLM
  TheBloke's Dockerfiles
  ☆308Updated last year
• adriacabeza / erudito
  Erudito: Easy API/CLI to ask questions about your documentation
  ☆99Updated 2 years ago
• JingShing / How-to-use-tesla-p40
  A manual for helping using tesla p40 gpu
  ☆139Updated last year
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆217Updated last year
• ChobPT / oobaboogas-webui-langchain_agent
  Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work
  ☆74Updated 2 years ago
• ghostpad / ghostpad
  A free AI text generation interface based on KoboldAI
  ☆33Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated 2 years ago
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆127Updated last year
• jjziets / gddr6_temps
  Prometheus exporter for Linux​ based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.
  ☆24Updated last year
• noco-ai / spellbook-docker
  AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models
  ☆168Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆189Updated last year
• johnsmith0031 / alpaca_lora_4bit
  ☆535Updated 2 years ago
• brucepro / Memoir
  Memoir+ a persona memory extension for Text Gen Web UI.
  ☆223Updated last month
• AlpinDale / gptslop
  A community list of common phrases generated by GPT and Claude models
  ☆79Updated 2 years ago
• xor2k / gpu_undervolt
  ☆48Updated 2 years ago
• agrocylo / bitsandbytes-rocm
  8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs
  ☆52Updated 2 years ago