WapaMario63 / GPTQ-for-LLaMa-ROCm

Related projects ⓘ

Alternatives and complementary repositories for GPTQ-for-LLaMa-ROCm

• evshiron / rocm_lab
  DEPRECATED!
  ☆53Updated 5 months ago
• agrocylo / bitsandbytes-rocm
  8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs
  ☆44Updated last year
• LostRuins / lite.koboldai.net
  A zero dependency web UI for any LLM backend, including KoboldCpp, OpenAI and AI Horde
  ☆81Updated this week
• ghostpad / ghostpad
  A free AI text generation interface based on KoboldAI
  ☆32Updated 8 months ago
• 0cc4m / KoboldAI
  ☆150Updated last year
• SillyTavern / SillyTavern-WebSearch-Selenium
  Add-on for the Web Search extension that provides the web browsing capabilities without the need for Extras API.
  ☆24Updated 6 months ago
• DavG25 / text-generation-webui-code_syntax_highlight
  An extension for oobabooga's text-generation-webui that adds syntax highlighting to code snippets
  ☆64Updated 5 months ago
• kaiokendev / superbig
  A prompt/context management system
  ☆165Updated last year
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆107Updated 3 weeks ago
• ChobPT / oobaboogas-webui-langchain_agent
  Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work
  ☆73Updated last year
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆173Updated last month
• turboderp / exui
  Web UI for ExLlamaV2
  ☆445Updated last month
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆100Updated 6 months ago
• dibrale / webui_autonomics
  Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.
  ☆34Updated last year
• jllllll / llama-cpp-python-cuBLAS-wheels
  Wheels for llama-cpp-python compiled with cuBLAS support
  ☆94Updated 9 months ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆124Updated last year
• arlo-phoenix / bitsandbytes-rocm-5.6
  8-bit CUDA functions for PyTorch Rocm compatible
  ☆39Updated 7 months ago
• theubie / simple_memory
  An extension to Oobabooga to add a simple memory function for chat
  ☆23Updated last year
• itsPreto / baby-code
  100% Private & Simple. OSS 🐍 Code Interpreter for LLMs 🦙
  ☆34Updated last year
• nydasco / jen-ai
  A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.
  ☆42Updated 9 months ago
• janhq / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆40Updated last month
• atisharma / chasm_engine
  CHAracter State Management - a generative text adventure (engine)
  ☆61Updated last month
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆126Updated 6 months ago
• FartyPants / Playground
  Text WebUI extension to add clever Notebooks to Chat mode
  ☆133Updated 10 months ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆66Updated last year
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆111Updated last year
• SicariusSicariiStuff / Diffusion_TTS
  Diffusion_TTS extension for booga
  ☆63Updated 4 months ago
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated 5 months ago
• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆130Updated last year
• mostlygeek / llama-swap
  HTTP proxy for on-demand model loading with llama.cpp (or other OpenAI compatible backends)
  ☆41Updated this week