nktice / AMD-AILinks
AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
☆210Updated last week
Alternatives and similar repositories for AMD-AI
Users that are interested in AMD-AI are comparing it to the libraries listed below
Sorting:
- ☆393Updated 5 months ago
- AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading☆692Updated 3 weeks ago
- Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.☆207Updated this week
- A daemon that automatically manages the performance states of NVIDIA GPUs.☆96Updated 3 weeks ago
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,050Updated last month
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆499Updated this week
- Lightweight Inference server for OpenVINO☆211Updated this week
- llama.cpp fork with additional SOTA quants and improved performance☆1,198Updated this week
- Web UI for ExLlamaV2☆513Updated 7 months ago
- Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs☆53Updated 4 months ago
- LLM Benchmark for Throughput via Ollama (Local LLMs)☆295Updated last month
- Model swapping for llama.cpp (or any local OpenAI API compatible server)☆1,579Updated this week
- A complete install script for the complete AMD ROCm ML stack allowing you to get the most out of your hardware with the least amount of s…☆36Updated last week
- ☆231Updated 2 years ago
- Dolphin System Messages☆349Updated 7 months ago
- Linux based GDDR6/GDDR6X VRAM temperature reader for NVIDIA RTX 3000/4000 series GPUs.☆105Updated 5 months ago
- Stable Diffusion Docker image preconfigured for usage with AMD Radeon cards☆139Updated last year
- 8-bit CUDA functions for PyTorch Rocm compatible☆41Updated last year
- Prometheus exporter for Linux based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.☆23Updated 11 months ago
- ☆85Updated last week
- Docker variants of oobabooga's text-generation-webui, including pre-built images.☆441Updated 2 months ago
- ☆468Updated this week
- An OpenAI API compatible text to speech server using Coqui AI's xtts_v2 and/or piper tts as the backend.☆816Updated 7 months ago
- ROCm docker images with fixes/support for extra architectures, such as gfx803/gfx1010.☆31Updated 2 years ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆163Updated last year
- Everything you need to setup on your AMD system for Machine Learning Stuff☆18Updated last month
- A manual for helping using tesla p40 gpu☆130Updated 10 months ago
- General Site for the GFX803 ROCm Stuff☆113Updated last month
- ☆257Updated last week
- Simple monkeypatch to boost AMD Navi 3 GPUs☆46Updated 5 months ago