Alternatives and similar repositories for triton-gfx906

Users that are interested in triton-gfx906 are comparing it to the libraries listed below

• nlzy / vllm-gfx906
  vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
  ☆247Updated this week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,181Updated this week
• mostlygeek / llama-swap
  Model swapping for llama.cpp (or any local OpenAI API compatible server)
  ☆1,499Updated last week
• maaaxinfinity / ktrun
  KTransformers 一键部署脚本
  ☆51Updated 5 months ago
• Said-Akbar / vllm-rocm
  FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆64Updated 4 months ago
• gpustack / gpustack
  Simple, scalable AI model deployment on GPU clusters
  ☆3,695Updated last week
• lamikr / rocm_sdk_builder
  ☆391Updated 5 months ago
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆273Updated last month
• amd / RyzenAI-SW
  AMD Ryzen™ AI Software includes the tools and runtime libraries for optimizing and deploying AI inference on AMD Ryzen™ AI powered PCs.
  ☆639Updated last month
• Pelochus / ezrknn-llm
  Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series
  ☆149Updated last month
• amd / xdna-driver
  ☆466Updated this week
• XiongjieDai / GPU-Benchmarks-on-LLM-Inference
  Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?
  ☆1,764Updated last year
• ml-explore / mlx-lm
  Run LLMs with MLX
  ☆2,313Updated this week
• amd / gaia
  Run LLM Agents on Ryzen AI PCs in Minutes
  ☆575Updated this week
• LMCache / LMCache
  Supercharge Your LLM with the Fastest KV Cache Layer
  ☆5,210Updated this week
• NotPunchnox / rkllama
  Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…
  ☆286Updated last week
• xuhuisheng / rocm-gfx803
  ☆231Updated 2 years ago
• xorbitsai / inference
  Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you ne…
  ☆8,523Updated this week
• b4rtaz / distributed-llama
  Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
  ☆2,639Updated this week
• Pelochus / ezrknpu
  Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs
  ☆181Updated last month
• mixa3607 / ML-gfx906
  ML software (llama.cpp, ComfyUI) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
  ☆15Updated 3 weeks ago
• zilliztech / deep-searcher
  Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.
  ☆6,938Updated 2 months ago
• microsoft / KBLaM
  Official Implementation of "KBLaM: Knowledge Base augmented Language Model"
  ☆1,395Updated last week
• Kiln-AI / Kiln
  The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.
  ☆4,133Updated this week
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆210Updated 6 months ago
• SaiAkhil066 / DeepSeek-RAG-Chatbot
  100 % FREE, Private (No Internet) DeepSeek’s Advanced RAG: Boost Your RAG Chatbot: Hybrid Retrieval (BM25 + FAISS) + Neural Reranking + H…
  ☆1,650Updated 2 weeks ago
• YellowRoseCx / koboldcpp-rocm
  AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
  ☆690Updated 3 weeks ago
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆1,047Updated 3 weeks ago
• txg1550759 / ktransformers-v0.3-docker
  ktransformers v0.3 docker build and run
  ☆13Updated 6 months ago
• deepseek-ai / FlashMLA
  FlashMLA: Efficient MLA kernels
  ☆11,721Updated 3 weeks ago