Alternatives and similar repositories for llamacpp-rocm

Users that are interested in llamacpp-rocm are comparing it to the libraries listed below

• FastFlowLM / FastFlowLM
  Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
  ☆637Updated this week
• SearchSavior / OpenArc
  Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
  ☆274Updated this week
• lhl / strix-halo-testing
  ☆186Updated 2 months ago
• kyuz0 / amd-strix-halo-toolboxes
  ☆770Updated this week
• ubergarm / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆21Updated last week
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆216Updated last month
• amd / gaia
  Build AI agents for your PC
  ☆885Updated this week
• Thireus / GGUF-Tool-Suite
  Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input your VRAM and RAM and the toolcha…
  ☆76Updated this week
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆617Updated this week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,511Updated this week
• k-koehler / gguf-tensor-overrider
  ☆50Updated 3 months ago
• ROCm / TheRock
  The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm
  ☆724Updated this week
• shantur / amd-strix-halo-fine-tuning-toolboxes
  LLM Fine Tuning Toolbox images for Ryzen AI 395+ Strix Halo
  ☆42Updated 4 months ago
• intel / llm-scaler
  ☆119Updated last week
• mixa3607 / ML-gfx906
  ML software (llama.cpp, ComfyUI, vLLM) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
  ☆98Updated 2 months ago
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆107Updated 2 months ago
• kyuz0 / amd-strix-halo-vllm-toolboxes
  ☆102Updated 3 weeks ago
• nlzy / vllm-gfx906
  vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
  ☆362Updated 3 weeks ago
• mattcurf / ollama-intel-gpu
  ☆257Updated 7 months ago
• pwilkin / llama-runner
  Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends
  ☆50Updated 4 months ago
• crashr / gppm
  GPU Power and Performance Manager
  ☆65Updated last year
• theroyallab / YALS
  ☆88Updated last month
• mostlygeek / llama-swap
  Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
  ☆2,176Updated last week
• lemonade-sdk / lemonade
  Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https…
  ☆2,008Updated this week
• TesslateAI / Agent-Builder
  ☆204Updated 4 months ago
• sasha0552 / nvidia-pstate
  A library and CLI utilities for managing performance states of NVIDIA GPUs.
  ☆32Updated last year
• thushan / olla
  High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model di…
  ☆127Updated this week
• iacopPBK / llama.cpp-gfx906
  llama.cpp-gfx906
  ☆84Updated this week
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆348Updated 6 months ago
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆119Updated last year