nlzy / triton-gfx906Links
triton for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
☆32Updated last month
Alternatives and similar repositories for triton-gfx906
Users that are interested in triton-gfx906 are comparing it to the libraries listed below
Sorting:
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆307Updated 3 weeks ago
- llama.cpp fork with additional SOTA quants and improved performance☆1,277Updated this week
- Triton for AMD MI25/50/60. Development repository for the Triton language and compiler☆32Updated last month
- FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs☆64Updated 5 months ago
- ML software (llama.cpp, ComfyUI, vLLM) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆34Updated last week
- llama.cpp-gfx906☆45Updated last month
- LM inference server implementation based on *.cpp.☆286Updated 2 months ago
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆541Updated 2 weeks ago
- Docs for GGUF quantization (unofficial)☆293Updated 3 months ago
- run DeepSeek-R1 GGUFs on KTransformers☆254Updated 7 months ago
- Reliable model swapping for any local OpenAI compatible server - llama.cpp, vllm, etc☆1,764Updated this week
- The main repository for building Pascal-compatible versions of ML applications and libraries.☆138Updated 2 months ago
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.☆226Updated this week
- Implements harmful/harmless refusal removal using pure HF Transformers☆1,222Updated last year
- The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm☆514Updated this week
- Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.☆378Updated this week
- Simple, scalable AI model deployment on GPU clusters☆3,903Updated last week
- Run LLM Agents on Ryzen AI PCs in Minutes☆684Updated last week
- KTransformers 一键部署脚本☆51Updated 6 months ago
- AMD Ryzen™ AI Software includes the tools and runtime libraries for optimizing and deploying AI inference on AMD Ryzen™ AI powered PCs.☆677Updated last week
- A fork of vLLM enabling Pascal architecture GPUs☆29Updated 8 months ago
- llama.cpp fork with additional SOTA quants and improved performance☆21Updated last week
- Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration☆79Updated this week
- Review/Check GGUF files and estimate the memory usage and maximum tokens per second.☆211Updated 2 months ago
- Low-bit LLM inference on CPU/NPU with lookup table☆879Updated 4 months ago
- CI scripts designed to build a Pascal-compatible version of vLLM.☆12Updated last year
- Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)☆727Updated this week
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,068Updated last week
- Manifold is a platform for enabling workflow automation using AI assistants.☆464Updated this week
- WilmerAI is one of the oldest LLM semantic routers. It uses multi-layer prompt routing and complex workflows to allow you to not only cre…☆784Updated 2 weeks ago