nktice / AMD-AI
AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
☆204Updated 2 months ago
Alternatives and similar repositories for AMD-AI
Users that are interested in AMD-AI are comparing it to the libraries listed below
Sorting:
- ☆313Updated last month
- AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading☆607Updated last month
- Stable Diffusion Docker image preconfigured for usage with AMD Radeon cards☆132Updated 11 months ago
- 8-bit CUDA functions for PyTorch Rocm compatible☆40Updated last year
- build scripts for ROCm☆186Updated last year
- Lightweight Inference server for OpenVINO☆165Updated last week
- ☆227Updated 2 years ago
- 8-bit CUDA functions for PyTorch☆52Updated 2 weeks ago
- ROCm docker images with fixes/support for extra architectures, such as gfx803/gfx1010.☆29Updated last year
- Run stable-diffusion-webui with Radeon RX 580 8GB on Ubuntu 22.04.2 LTS☆63Updated last year
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆944Updated this week
- CUDA on AMD GPUs☆481Updated this week
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆351Updated this week
- 8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs☆49Updated 2 years ago
- ☆69Updated this week
- Web UI for ExLlamaV2☆496Updated 3 months ago
- Stable Diffusion v1.7.0 & v1.9.3 & v1.10.1 on RDNA2 RDNA3 AMD ROCm with Docker-compose☆12Updated 6 months ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆152Updated 11 months ago
- Dolphin System Messages☆304Updated 2 months ago
- DEPRECATED!☆52Updated 10 months ago
- add support on amd in zluda☆57Updated last month
- ☆410Updated this week
- A daemon that automatically manages the performance states of NVIDIA GPUs.☆77Updated 2 weeks ago
- Simple monkeypatch to boost AMD Navi 3 GPUs☆39Updated 3 weeks ago
- Forge for stable-diffusion-webui-amdgpu (formerly stable-diffusion-webui-directml)☆119Updated 3 weeks ago
- Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs☆40Updated 5 months ago
- Model swapping for llama.cpp (or any local OpenAPI compatible server)☆745Updated this week
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆313Updated 2 months ago
- An extension for oobabooga/text-generation-webui that enables the LLM to search the web using DuckDuckGo☆241Updated last week
- A Docker image based on rocm/pytorch with support for gfx803(Polaris 20-21 (XT/PRO/XL); RX580; RX570; RX560) and Python 3.8☆23Updated 2 years ago