nktice / AMD-AI
AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
☆184Updated 2 months ago
Alternatives and similar repositories for AMD-AI:
Users that are interested in AMD-AI are comparing it to the libraries listed below
- AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading☆497Updated last week
- ☆164Updated this week
- 8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs☆45Updated last year
- 8-bit CUDA functions for PyTorch Rocm compatible☆39Updated 9 months ago
- transparent proxy server for llama.cpp's server to provide automatic model swapping☆135Updated this week
- DEPRECATED!☆53Updated 6 months ago
- Stable Diffusion Docker image preconfigured for usage with AMD Radeon cards☆129Updated 7 months ago
- An OAI compatible exllamav2 API that's both lightweight and fast☆733Updated this week
- Web UI for ExLlamaV2☆460Updated 3 weeks ago
- A daemon that automatically manages the performance states of NVIDIA GPUs.☆50Updated 2 months ago
- build scripts for ROCm☆183Updated last year
- 4 bits quantization of LLaMA using GPTQ, ported to HIP for use in AMD GPUs.☆32Updated last year
- A manual for helping using tesla p40 gpu☆111Updated 2 months ago
- Prometheus exporter for Linux based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.☆16Updated 3 months ago
- Dolphin System Messages☆226Updated 3 months ago
- An OpenAI API compatible text to speech server using Coqui AI's xtts_v2 and/or piper tts as the backend.☆622Updated 4 months ago
- Stable Difussion inference on Intel Arc dGPUs☆70Updated 9 months ago
- Croco.Cpp is a 3rd party testground for KoboldCPP, a simple one-file way to run various GGML/GGUF models with KoboldAI's UI. (for Croco.C…☆91Updated this week
- An AI assistant beyond the chat box.☆317Updated 10 months ago
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆282Updated 2 weeks ago
- LLM Frontend in a single html file☆305Updated this week
- Memoir+ a persona extension for Text Gen Web UI. That includes memory, emotions, command handling and more.☆180Updated 3 weeks ago
- ☆349Updated this week
- 8-bit CUDA functions for PyTorch☆42Updated this week
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆217Updated last month
- Simple UI for Llama-3.2-11B-Vision & Molmo-7B-D☆131Updated 3 months ago
- Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs☆27Updated last month
- My personal fork of koboldcpp where I hack in experimental samplers.☆42Updated 8 months ago
- Stable Diffusion v1.7.0 & v1.9.3 & v1.10.1 on RDNA2 RDNA3 AMD ROCm with Docker-compose☆12Updated 2 months ago
- ☆40Updated last year