Alternatives and similar repositories for AMD-AI

Users that are interested in AMD-AI are comparing it to the libraries listed below

• lamikr / rocm_sdk_builder
  ☆326Updated 2 months ago
• l1na-forever / stable-diffusion-rocm-docker
  Stable Diffusion Docker image preconfigured for usage with AMD Radeon cards
  ☆133Updated last year
• YellowRoseCx / koboldcpp-rocm
  AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
  ☆624Updated this week
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆969Updated this week
• xuhuisheng / rocm-gfx803
  ☆226Updated 2 years ago
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆495Updated 4 months ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆176Updated last week
• xuhuisheng / rocm-build
  build scripts for ROCm
  ☆186Updated last year
• LostRuins / lite.koboldai.net
  A zero dependency web UI for any LLM backend, including KoboldCpp, OpenAI and AI Horde
  ☆121Updated this week
• JingShing / How-to-use-tesla-p40
  A manual for helping using tesla p40 gpu
  ☆126Updated 6 months ago
• Nexesenex / croco.cpp
  Croco.Cpp is a 3rd party testground for KoboldCPP, a simple one-file way to run various GGML/GGUF models with KoboldAI's UI. (for Croco.C…
  ☆107Updated this week
• Beinsezii / comfyui-amd-go-fast
  Simple monkeypatch to boost AMD Navi 3 GPUs
  ☆42Updated last month
• agrocylo / bitsandbytes-rocm
  8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs
  ☆49Updated 2 years ago
• arlo-phoenix / bitsandbytes-rocm-5.6
  8-bit CUDA functions for PyTorch Rocm compatible
  ☆41Updated last year
• theroyallab / YALS
  ☆71Updated last week
• amd / RyzenAI-SW
  ☆525Updated 2 weeks ago
• ulyssesrr / docker-rocm-xtra
  ROCm docker images with fixes/support for extra architectures, such as gfx803/gfx1010.
  ☆30Updated last year
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆86Updated last month
• pomoke / torch-apu-helper
  Make PyTorch models at least run on APUs.
  ☆55Updated last year
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆385Updated this week
• tsl0922 / pytorch-gfx803
  Run stable-diffusion-webui with Radeon RX 580 8GB on Ubuntu 22.04.2 LTS
  ☆63Updated last year
• ThomasBaruzier / gddr6-core-junction-vram-temps
  Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs
  ☆42Updated 3 weeks ago
• brknsoul / ROCmLibs
  Prebuilt Windows ROCm Libs for gfx1031 and gfx1032
  ☆138Updated 2 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆519Updated this week
• FartyPants / StoryCrafter
  Writing Extension for Text Generation WebUI
  ☆55Updated 4 months ago
• lshqqytiger / ZLUDA
  CUDA on AMD GPUs
  ☆502Updated 3 weeks ago
• crashr / gppm
  GPU Power and Performance Manager
  ☆58Updated 7 months ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆153Updated last year
• cognitivecomputations / dolphin-system-messages
  Dolphin System Messages
  ☆311Updated 3 months ago
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆172Updated this week