Alternatives and similar repositories for llamacpp-rocm

Users that are interested in llamacpp-rocm are comparing it to the libraries listed below

• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆198Updated this week
• rjmalagon / ollama-linux-amd-apu
  AMD APU compatible Ollama. Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language mod…
  ☆80Updated last week
• FastFlowLM / FastFlowLM
  Run LLMs on AMD Ryzen™ AI NPUs. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
  ☆129Updated last week
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆209Updated 6 months ago
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆93Updated 2 months ago
• mattcurf / ollama-intel-gpu
  ☆253Updated 2 months ago
• lamikr / rocm_sdk_builder
  ☆381Updated 4 months ago
• pomoke / torch-apu-helper
  Make PyTorch models at least run on APUs.
  ☆56Updated last year
• jjziets / gddr6_temps
  Prometheus exporter for Linux​ based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.
  ☆22Updated 10 months ago
• lhl / strix-halo-testing
  ☆51Updated last week
• crashr / gppm
  GPU Power and Performance Manager
  ☆61Updated 10 months ago
• zhaohb / ollama_ov
  Add genai backend for ollama to run generative AI models using OpenVINO Runtime.
  ☆13Updated 2 months ago
• mostlygeek / llama-swap
  Model swapping for llama.cpp (or any local OpenAPI compatible server)
  ☆1,370Updated this week
• QuantiusBenignus / BlahST
  Input text from speech in any Linux window, the lean, fast and accurate way, using whisper.cpp OFFLINE. Speak with local LLMs via llama.c…
  ☆126Updated last month
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆251Updated last month
• segurac / force-host-alloction-APU
  ☆63Updated 3 months ago
• sasha0552 / nvidia-pstate
  A library and CLI utilities for managing performance states of NVIDIA GPUs.
  ☆28Updated 10 months ago
• kalavai-net / kalavai-client
  A platform to self-host AI on easy mode
  ☆159Updated 2 weeks ago
• AaronFeng753 / Better-R1
  A open webui function for better R1 experience
  ☆79Updated 5 months ago
• kyuz0 / amd-strix-halo-toolboxes
  ☆129Updated this week
• woodrex83 / ROCm-For-RX580
  ROCm docker images with fixes/support for legecy architecture gfx803. eg.Radeon RX 590/RX 580/RX 570/RX 480
  ☆73Updated 3 months ago
• kooshi / llama-swappo
  llama-swap + a minimal ollama compatible api
  ☆23Updated this week
• atineiatte / deep-research-at-home
  ☆221Updated 3 months ago
• robertrosenbusch / gfx803_rocm
  General Site for the GFX803 ROCm Stuff
  ☆103Updated 3 weeks ago
• amd / xdna-driver
  ☆461Updated this week
• amd / gaia
  Run LLM Agents on Ryzen AI PCs in Minutes
  ☆518Updated last week
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆280Updated 2 weeks ago
• lemonade-sdk / lemonade
  Lemonade helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPU…
  ☆1,098Updated this week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,096Updated this week
• taylorwilsdon / reddacted
  reddacted lets you analyze & sanitize your online footprint using LLMs, PII detection & sentiment analysis to identify anything that migh…
  ☆108Updated last month