Alternatives and similar repositories for vllm-rocm:

Users that are interested in vllm-rocm are comparing it to the libraries listed below

• Said-Akbar / triton-gcn5
  Triton for AMD MI25/50/60. Development repository for the Triton language and compiler
  ☆17Updated 2 weeks ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆231Updated this week
• ThomasBaruzier / gddr6-core-junction-vram-temps
  Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs
  ☆38Updated 3 months ago
• xor2k / gpu_undervolt
  ☆40Updated last year
• SicariusSicariiStuff / SLOP_Detector
  SLOP Detector and analyzer based on dictionary for shareGPT JSON and text
  ☆65Updated 5 months ago
• crashr / gppm
  GPU Power and Performance Manager
  ☆57Updated 5 months ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆143Updated this week
• Independent-AI-Labs / local-super-agents
  Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…
  ☆66Updated last week
• Beinsezii / comfyui-amd-go-fast
  Simple monkeypatch to boost AMD Navi 3 GPUs
  ☆36Updated 10 months ago
• mostlygeek / llama-swap
  transparent proxy server on demand model swapping for llama.cpp (or any local OpenAPI compatible server)
  ☆482Updated last week
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆148Updated 10 months ago
• agrocylo / bitsandbytes-rocm
  8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs
  ☆49Updated last year
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆55Updated last month
• arlo-phoenix / bitsandbytes-rocm-5.6
  8-bit CUDA functions for PyTorch Rocm compatible
  ☆39Updated last year
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆173Updated 6 months ago
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆486Updated last month
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆65Updated 5 months ago
• Nexesenex / croco.cpp
  Croco.Cpp is a 3rd party testground for KoboldCPP, a simple one-file way to run various GGML/GGUF models with KoboldAI's UI. (for Croco.C…
  ☆101Updated this week
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆212Updated last month
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆37Updated 7 months ago
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆64Updated 5 months ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆62Updated 2 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆164Updated this week
• noco-ai / spellbook-docker
  AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models
  ☆152Updated 11 months ago
• LostRuins / lite.koboldai.net
  A zero dependency web UI for any LLM backend, including KoboldCpp, OpenAI and AI Horde
  ☆107Updated this week
• severian42 / Vodalus-Expert-LLM-Forge
  Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …
  ☆178Updated 8 months ago
• rombodawg / Easy_training
  ☆46Updated last month
• fairydreaming / llama.cpp
  LLM inference in C/C++
  ☆19Updated last week
• FartyPants / Training_PRO
  Traing PRO extension for oobabooga WebUI - recent dev version
  ☆48Updated 2 months ago
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆163Updated this week