Alternatives and similar repositories for AMD-AI:

Users that are interested in AMD-AI are comparing it to the libraries listed below

• YellowRoseCx / koboldcpp-rocm
  AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
  ☆478Updated last week
• ROCm / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆39Updated last month
• agrocylo / bitsandbytes-rocm
  8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs
  ☆44Updated last year
• arlo-phoenix / bitsandbytes-rocm-5.6
  8-bit CUDA functions for PyTorch Rocm compatible
  ☆39Updated 8 months ago
• theroyallab / tabbyAPI
  An OAI compatible exllamav2 API that's both lightweight and fast
  ☆674Updated this week
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆148Updated this week
• patientx / ComfyUI-Zluda
  The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface. Now ZLUDA enhanced for better AMD GPU p…
  ☆185Updated this week
• lmg-anon / mikupad
  LLM Frontend in a single html file
  ☆272Updated 2 weeks ago
• Beinsezii / comfyui-amd-go-fast
  Simple monkeypatch to boost AMD Navi 3 GPUs
  ☆24Updated 7 months ago
• l1na-forever / stable-diffusion-rocm-docker
  Stable Diffusion Docker image preconfigured for usage with AMD Radeon cards
  ☆128Updated 6 months ago
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆168Updated 2 months ago
• xuhuisheng / rocm-gfx803
  ☆205Updated last year
• lshqqytiger / ZLUDA
  CUDA on AMD GPUs
  ☆318Updated 3 months ago
• turboderp / exui
  Web UI for ExLlamaV2
  ☆450Updated 2 months ago
• xuhuisheng / rocm-build
  build scripts for ROCm
  ☆181Updated 11 months ago
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆44Updated last month
• cognitivecomputations / dolphin-system-messages
  Dolphin System Messages
  ☆216Updated 2 months ago
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆209Updated 2 months ago
• matatonic / openedai-speech
  An OpenAI API compatible text to speech server using Coqui AI's xtts_v2 and/or piper tts as the backend.
  ☆538Updated 3 months ago
• mostlygeek / llama-swap
  On-demand model switching with llama.cpp (or other OpenAI compatible backends)
  ☆109Updated this week
• lamikr / rocm_sdk_builder
  ☆145Updated this week
• WapaMario63 / GPTQ-for-LLaMa-ROCm
  4 bits quantization of LLaMA using GPTQ, ported to HIP for use in AMD GPUs.
  ☆32Updated last year
• ulyssesrr / docker-rocm-xtra
  ROCm docker images with fixes/support for extra architectures, such as gfx803/gfx1010.
  ☆25Updated last year
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆131Updated 7 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆175Updated 7 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆112Updated this week
• AndrewVeee / nucleo-ai
  An AI assistant beyond the chat box.
  ☆316Updated 9 months ago
• crashr / gppm
  GPU Power and Performance Manager
  ☆51Updated 2 months ago
• JingShing / How-to-use-tesla-p40
  A manual for helping using tesla p40 gpu
  ☆106Updated last month
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆141Updated 3 months ago