nlzy / triton-gfx906Links
triton for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
☆38Updated last month
Alternatives and similar repositories for triton-gfx906
Users that are interested in triton-gfx906 are comparing it to the libraries listed below
Sorting:
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆355Updated last week
- llama.cpp fork with additional SOTA quants and improved performance☆1,455Updated this week
- ML software (llama.cpp, ComfyUI, vLLM) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆90Updated last month
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆613Updated this week
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆2,147Updated last week
- Run LLM Agents on Ryzen AI PCs in Minutes☆843Updated last week
- llama.cpp-gfx906☆75Updated 3 weeks ago
- FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs☆65Updated 8 months ago
- Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration☆155Updated this week
- Implements harmful/harmless refusal removal using pure HF Transformers☆1,398Updated last month
- Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.☆591Updated last week
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.☆270Updated last week
- KTransformers 一键部署脚本☆55Updated 8 months ago
- AMD Ryzen™ AI Software includes the tools and runtime libraries for optimizing and deploying AI inference on AMD Ryzen™ AI powered PCs.☆727Updated 3 weeks ago
- The main repository for building Pascal-compatible versions of ML applications and libraries.☆158Updated 4 months ago
- Review/Check GGUF files and estimate the memory usage and maximum tokens per second.☆223Updated this week
- ROCm Library Files for gfx1103 and update with others arches based on AMD GPUs for use in Windows.☆727Updated 3 months ago
- LM inference server implementation based on *.cpp.☆295Updated last month
- LLM model quantization (compression) toolkit with hw acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU and Intel/AMD/Apple CPU vi…☆960Updated this week
- Docs for GGUF quantization (unofficial)☆343Updated 5 months ago
- The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm☆690Updated this week
- A fork of vLLM enabling Pascal architecture GPUs☆31Updated 10 months ago
- Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series☆164Updated 5 months ago
- AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1☆216Updated last month
- CI scripts designed to build a Pascal-compatible version of vLLM.☆12Updated last year
- Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https…☆1,954Updated last week
- Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)☆760Updated this week
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,103Updated 2 weeks ago
- Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?☆1,862Updated last year
- ☆718Updated 2 weeks ago