Alternatives and similar repositories for GPTQ-for-LLaMa-ROCm

Users that are interested in GPTQ-for-LLaMa-ROCm are comparing it to the libraries listed below

• evshiron / rocm_lab
  DEPRECATED!
  ☆52Updated last year
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆209Updated 5 months ago
• agrocylo / bitsandbytes-rocm
  8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs
  ☆50Updated 2 years ago
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆505Updated 6 months ago
• broncotc / bitsandbytes-rocm
  ☆37Updated 2 years ago
• wawawario2 / long_term_memory
  A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.
  ☆307Updated last year
• jllllll / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆98Updated last year
• TheBlokeAI / dockerLLM
  TheBloke's Dockerfiles
  ☆305Updated last year
• ghostpad / ghostpad
  A free AI text generation interface based on KoboldAI
  ☆34Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• arlo-phoenix / bitsandbytes-rocm-5.6
  8-bit CUDA functions for PyTorch Rocm compatible
  ☆41Updated last year
• xr4dsh / CodeRunner
  ☆29Updated last year
• 0cc4m / KoboldAI
  ☆158Updated last year
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆158Updated last year
• theroyallab / YALS
  ☆81Updated 2 weeks ago
• hommayushi3 / exllama-runpod-serverless
  ☆52Updated last year
• xor2k / gpu_undervolt
  ☆42Updated 2 years ago
• ParisNeo / lollms_legacy
  Lord of LLMS
  ☆295Updated 2 weeks ago
• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆130Updated 2 years ago
• Ph0rk0z / text-generation-webui-testing
  A fork of textgen that kept some things like Exllama and old GPTQ.
  ☆22Updated 11 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆185Updated last year
• mamei16 / LLM_Web_search
  An extension for oobabooga/text-generation-webui that enables the LLM to search the web
  ☆255Updated this week
• stduhpf / stable-diffusion.cpp
  Stable Diffusion and Flux in pure C/C++
  ☆20Updated this week
• johnsmith0031 / alpaca_lora_4bit
  ☆534Updated last year
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆215Updated 10 months ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated 2 years ago
• JingShing / How-to-use-tesla-p40
  A manual for helping using tesla p40 gpu
  ☆127Updated 8 months ago
• AlpinDale / gptslop
  A community list of common phrases generated by GPT and Claude models
  ☆77Updated last year
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆108Updated 9 months ago
• Atinoda / text-generation-webui-docker
  Docker variants of oobabooga's text-generation-webui, including pre-built images.
  ☆433Updated last month