Alternatives and similar repositories for triton-gfx906

Users that are interested in triton-gfx906 are comparing it to the libraries listed below

• nlzy / vllm-gfx906
  vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
  ☆327Updated last month
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,329Updated this week
• mixa3607 / ML-gfx906
  ML software (llama.cpp, ComfyUI, vLLM) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
  ☆53Updated last week
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆571Updated last week
• Said-Akbar / vllm-rocm
  FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆65Updated 6 months ago
• mostlygeek / llama-swap
  Reliable model swapping for any local OpenAI compatible server - llama.cpp, vllm, etc
  ☆1,899Updated this week
• Said-Akbar / triton-gcn5
  Triton for AMD MI25/50/60. Development repository for the Triton language and compiler
  ☆32Updated 3 weeks ago
• Sumandora / remove-refusals-with-transformers
  Implements harmful/harmless refusal removal using pure HF Transformers
  ☆1,275Updated last year
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆290Updated 3 months ago
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆255Updated 8 months ago
• gpustack / gpustack
  Simple, scalable AI model deployment on GPU clusters
  ☆4,008Updated this week
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆1,090Updated this week
• sasha0552 / vllm-ci
  CI scripts designed to build a Pascal-compatible version of vLLM.
  ☆12Updated last year
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆216Updated 3 months ago
• ModelCloud / GPTQModel
  LLM model quantization (compression) toolkit with hw acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU and Intel/AMD/Apple CPU vi…
  ☆886Updated this week
• sasha0552 / pascal-pkgs-ci
  The main repository for building Pascal-compatible versions of ML applications and libraries.
  ☆147Updated 2 months ago
• iacopPBK / llama.cpp-gfx906
  llama.cpp-gfx906
  ☆49Updated last week
• maaaxinfinity / ktrun
  KTransformers 一键部署脚本
  ☆54Updated 7 months ago
• SearchSavior / OpenArc
  Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
  ☆241Updated last week
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆746Updated this week
• LeanModels / DFloat11
  DFloat11: Lossless LLM Compression for Efficient GPU Inference
  ☆560Updated 2 months ago
• FastFlowLM / FastFlowLM
  Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
  ☆451Updated this week
• thu-pacman / chitu
  High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
  ☆1,331Updated this week
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,591Updated this week
• cduk / vllm-pascal
  A fork of vLLM enabling Pascal architecture GPUs
  ☆30Updated 9 months ago
• Thireus / GGUF-Tool-Suite
  Input your VRAM and RAM and the toolchain will produce a GGUF model tuned to your system within seconds — flexible model sizing and lowes…
  ☆63Updated this week
• dCaples / AutoDidact
  Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.
  ☆671Updated 7 months ago
• amd / gaia
  Run LLM Agents on Ryzen AI PCs in Minutes
  ☆744Updated this week
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆312Updated 4 months ago
• microsoft / VPTQ
  VPTQ, A Flexible and Extreme low-bit quantization algorithm
  ☆666Updated 6 months ago