Alternatives and similar repositories for AMD-AI:

Users that are interested in AMD-AI are comparing it to the libraries listed below

• YellowRoseCx / koboldcpp-rocm
  AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
  ☆577Updated last week
• lamikr / rocm_sdk_builder
  ☆274Updated this week
• ROCm / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆45Updated last month
• arlo-phoenix / bitsandbytes-rocm-5.6
  8-bit CUDA functions for PyTorch Rocm compatible
  ☆39Updated last year
• theroyallab / tabbyAPI
  An OAI compatible exllamav2 API that's both lightweight and fast
  ☆873Updated this week
• mostlygeek / llama-swap
  transparent proxy server on demand model swapping for llama.cpp (or any local OpenAPI compatible server)
  ☆475Updated this week
• l1na-forever / stable-diffusion-rocm-docker
  Stable Diffusion Docker image preconfigured for usage with AMD Radeon cards
  ☆132Updated 10 months ago
• Beinsezii / comfyui-amd-go-fast
  Simple monkeypatch to boost AMD Navi 3 GPUs
  ☆35Updated 10 months ago
• cognitivecomputations / dolphin-system-messages
  Dolphin System Messages
  ☆274Updated last month
• amd / RyzenAI-SW
  ☆491Updated 3 weeks ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆222Updated this week
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆148Updated 10 months ago
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆486Updated last month
• matatonic / openedai-speech
  An OpenAI API compatible text to speech server using Coqui AI's xtts_v2 and/or piper tts as the backend.
  ☆726Updated last month
• brknsoul / ROCmLibs
  Prebuilt Windows ROCm Libs for gfx1031 and gfx1032
  ☆114Updated last week
• amd / xdna-driver
  ☆398Updated this week
• mattcurf / ollama-intel-gpu
  ☆191Updated last week
• Grench6 / RX580-rocM-tensorflow-ubuntu20.4-guide
  Install guide of ROCm and Tensorflow on Ubuntu for the RX580
  ☆123Updated 5 months ago
• agrocylo / bitsandbytes-rocm
  8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs
  ☆49Updated last year
• xuhuisheng / rocm-gfx803
  ☆227Updated 2 years ago
• ThomasBaruzier / gddr6-core-junction-vram-temps
  Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs
  ☆33Updated 3 months ago
• JingShing / How-to-use-tesla-p40
  A manual for helping using tesla p40 gpu
  ☆121Updated 4 months ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆142Updated this week
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆162Updated this week
• segurac / force-host-alloction-APU
  ☆51Updated last year
• xuhuisheng / rocm-build
  build scripts for ROCm
  ☆188Updated last year
• lshqqytiger / ZLUDA
  CUDA on AMD GPUs
  ☆422Updated this week
• evshiron / rocm_lab
  DEPRECATED!
  ☆52Updated 9 months ago
• intel / openvino-ai-plugins-gimp
  GIMP AI plugins with OpenVINO Backend
  ☆585Updated last month
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆183Updated 11 months ago