Alternatives and similar repositories for CTranslate2-rocm

Users that are interested in CTranslate2-rocm are comparing it to the libraries listed below

• lamikr / rocm_sdk_builder
  ☆356Updated 3 months ago
• YellowRoseCx / koboldcpp-rocm
  AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
  ☆647Updated 2 weeks ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆436Updated this week
• Beinsezii / comfyui-amd-go-fast
  Simple monkeypatch to boost AMD Navi 3 GPUs
  ☆43Updated 2 months ago
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆209Updated 4 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆652Updated this week
• ulyssesrr / docker-rocm-xtra
  ROCm docker images with fixes/support for extra architectures, such as gfx803/gfx1010.
  ☆30Updated last year
• ThomasBaruzier / gddr6-core-junction-vram-temps
  Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs
  ☆47Updated 2 months ago
• mostlygeek / llama-swap
  Model swapping for llama.cpp (or any local OpenAPI compatible server)
  ☆1,035Updated 2 weeks ago
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆89Updated last month
• theroyallab / YALS
  ☆80Updated this week
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆1,000Updated this week
• olealgoritme / gddr6
  Linux​ based GDDR6/GDDR6X VRAM temperature reader for NVIDIA RTX 3000/4000 series GPUs.
  ☆101Updated 2 months ago
• stduhpf / stable-diffusion.cpp
  Stable Diffusion and Flux in pure C/C++
  ☆20Updated this week
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆503Updated 5 months ago
• QuantiusBenignus / BlahST
  Input text from speech in any Linux window, the lean, fast and accurate way, using whisper.cpp OFFLINE. Speak with local LLMs via llama.c…
  ☆114Updated this week
• xuhuisheng / rocm-gfx803
  ☆233Updated 2 years ago
• Nexesenex / croco.cpp
  Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…
  ☆111Updated this week
• woodrex83 / ROCm-For-RX580
  ROCm docker images with fixes/support for legecy architecture gfx803. eg.Radeon RX 590/RX 580/RX 570/RX 480
  ☆70Updated last month
• lmg-anon / mikupad
  LLM Frontend in a single html file
  ☆517Updated 6 months ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆188Updated this week
• lshqqytiger / ZLUDA
  CUDA on AMD GPUs
  ☆527Updated 2 months ago
• xor2k / gpu_undervolt
  ☆42Updated 2 years ago
• ROCm / TheRock
  The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm
  ☆234Updated this week
• rjmalagon / ollama-linux-amd-apu
  AMD APU compatible Ollama. Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language mod…
  ☆63Updated this week
• xuhuisheng / rocm-build
  build scripts for ROCm
  ☆186Updated last year
• nlzy / vllm-gfx906
  vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
  ☆111Updated last week
• scooter-lacroix / Stan-s-ML-Stack
  A complete install script for the complete AMD ROCm ML stack allowing you to get the most out of your hardware with the least amount of s…
  ☆29Updated last month
• arlo-phoenix / bitsandbytes-rocm-5.6
  8-bit CUDA functions for PyTorch Rocm compatible
  ☆41Updated last year
• robertrosenbusch / gfx803_rocm
  General Site for the GFX803 ROCm Stuff
  ☆89Updated 3 weeks ago