Alternatives and similar repositories for vllm-rocm

Users that are interested in vllm-rocm are comparing it to the libraries listed below

• Said-Akbar / triton-gcn5
  Triton for AMD MI25/50/60. Development repository for the Triton language and compiler
  ☆26Updated 2 months ago
• nlzy / vllm-gfx906
  vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
  ☆63Updated last week
• fairydreaming / llama.cpp
  LLM inference in C/C++
  ☆21Updated 2 months ago
• vproxy-tools / ktransformers
  A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
  ☆40Updated last month
• fattank / deepseek-on-vllm-VRAMandDRAM
  一套基于Vllm的显存内存混合模式大模型部署工具（图形界面），VRAMandDRAM模式虽然慢一点，但是解决了超大模型在普通家用计算机上的部署问题。
  ☆64Updated last month
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆234Updated 3 months ago
• and270 / thinking_effort_processor
  ☆89Updated 2 months ago
• ROCm / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆79Updated this week
• TesslateAI / TFrameX
  ☆120Updated 2 weeks ago
• zRzRzRzRzRzRzR / GLM-4
  GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型
  ☆26Updated last month
• pomoke / torch-apu-helper
  Make PyTorch models at least run on APUs.
  ☆55Updated last year
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆519Updated this week
• ssiu / flash-attention-turing
  ☆36Updated this week
• likelovewant / ROCmLibs-for-gfx1103-AMD780M-APU
  ROCm Library Files for gfx1103 and update with others arches based on AMD GPUs for use in Windows.
  ☆514Updated 4 months ago
• xuhuisheng / rocm-build
  build scripts for ROCm
  ☆186Updated last year
• iluxu / llmbasedos
  Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.
  ☆228Updated last week
• ByronLeeeee / Ollama-For-AMD-Installer
  This project simplifies the installation process of likelovewant's library, making it easier for users to manage and update their AMD GPU…
  ☆169Updated 2 months ago
• severian42 / MoA-Ollama-Chat
  This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…
  ☆116Updated 11 months ago
• Independent-AI-Labs / local-super-agents
  Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…
  ☆65Updated 2 months ago
• Viceman256 / TensorTune
  KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning
  ☆22Updated 2 weeks ago
• nick-tonjum / open-webui-artifacts-overhaul
  User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
  ☆266Updated 2 months ago
• chigkim / Ollama-MMLU-Pro
  ☆90Updated 5 months ago
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆72Updated 4 months ago
• aikitoria / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆25Updated 2 weeks ago
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆106Updated this week
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆77Updated 3 weeks ago
• Sumandora / remove-refusals-with-transformers
  Implements harmful/harmless refusal removal using pure HF Transformers
  ☆852Updated 11 months ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆180Updated this week
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆181Updated this week
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆203Updated last week