Alternatives and similar repositories for GPTQ-for-LLaMa-ROCm

Users that are interested in GPTQ-for-LLaMa-ROCm are comparing it to the libraries listed below

• agrocylo / bitsandbytes-rocm
  8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs
  ☆53Updated 2 years ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆249Updated 2 years ago
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆513Updated last year
• kaiokendev / superbig
  A prompt/context management system
  ☆168Updated 2 years ago
• wawawario2 / long_term_memory
  A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.
  ☆310Updated 2 years ago
• Ph0rk0z / text-generation-webui-testing
  A fork of textgen that kept some things like Exllama and old GPTQ.
  ☆22Updated last year
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆217Updated last week
• jllllll / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆102Updated 2 years ago
• 0cc4m / KoboldAI
  ☆156Updated 2 years ago
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆109Updated 2 years ago
• johnsmith0031 / alpaca_lora_4bit
  ☆535Updated 2 years ago
• xor2k / gpu_undervolt
  ☆50Updated 2 years ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆125Updated 2 years ago
• melodysdreamj / WizardVicunaLM
  LLM that combines the principles of wizardLM and vicunaLM
  ☆716Updated 2 years ago
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆128Updated last year
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆108Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated 2 years ago
• JingShing / How-to-use-tesla-p40
  A manual for helping using tesla p40 gpu
  ☆142Updated last year
• arlo-phoenix / bitsandbytes-rocm-5.6
  8-bit CUDA functions for PyTorch Rocm compatible
  ☆41Updated last year
• kalomaze / koboldcpp
  My personal fork of koboldcpp where I hack in experimental samplers.
  ☆44Updated last year
• lastmile-ai / llama-retrieval-plugin
  LLaMa retrieval plugin script using OpenAI's retrieval plugin
  ☆323Updated 2 years ago
• randaller / llama-cpu
  Inference on CPU code for LLaMA models
  ☆137Updated 2 years ago
• atisharma / chasm
  CHAracter State Management - a generative text adventure
  ☆55Updated 8 months ago
• RandomInternetPreson / text-generation-webui-barktts
  A simple extension that uses Bark Text-to-Speech for audio output
  ☆11Updated 2 years ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆118Updated last year
• ghostpad / ghostpad
  A free AI text generation interface based on KoboldAI
  ☆33Updated last year
• FartyPants / Playground
  Text WebUI extension to add clever Notebooks to Chat mode
  ☆146Updated 6 months ago
• AlpinDale / gptslop
  A community list of common phrases generated by GPT and Claude models
  ☆79Updated 2 years ago
• flurb18 / AgentOoba
  An autonomous AI agent extension for Oobabooga's web ui
  ☆173Updated 2 years ago
• AlpinDale / sparsegpt-for-LLaMA
  Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.
  ☆71Updated 2 years ago