Alternatives and similar repositories for CTranslate2-rocm

Users that are interested in CTranslate2-rocm are comparing it to the libraries listed below

• lamikr / rocm_sdk_builder
  ☆399Updated 6 months ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆513Updated last week
• YellowRoseCx / koboldcpp-rocm
  AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading
  ☆699Updated last month
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,246Updated this week
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆1,061Updated this week
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆211Updated 3 weeks ago
• scooter-lacroix / Stan-s-ML-Stack
  A complete package that provides you with all the components needed to get started of dive deeper into Machine Learning Workloads on Cons…
  ☆38Updated last week
• ROCm / TheRock
  The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm
  ☆438Updated this week
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆95Updated 2 weeks ago
• kooshi / llama-swappo
  llama-swap + a minimal ollama compatible api
  ☆28Updated this week
• SearchSavior / OpenArc
  Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS over OpenAI endpoints.
  ☆211Updated this week
• Beinsezii / comfyui-amd-go-fast
  Simple monkeypatch to boost AMD Navi 3 GPUs
  ☆46Updated 5 months ago
• theroyallab / YALS
  ☆83Updated this week
• ulyssesrr / docker-rocm-xtra
  ROCm docker images with fixes/support for extra architectures, such as gfx803/gfx1010.
  ☆31Updated 2 years ago
• lmg-anon / mikupad
  LLM Frontend in a single html file
  ☆647Updated 8 months ago
• xor2k / gpu_undervolt
  ☆42Updated 2 years ago
• mostlygeek / llama-swap
  Model swapping for llama.cpp (or any local OpenAI API compatible server)
  ☆1,655Updated this week
• mehtabmahir / easy-whisper-ui
  Easy to use interface for the Whisper model optimized for all GPUs!
  ☆320Updated 2 months ago
• olealgoritme / gddr6
  Linux​ based GDDR6/GDDR6X VRAM temperature reader for NVIDIA RTX 3000/4000 series GPUs.
  ☆104Updated 5 months ago
• Softcatala / whisper-ctranslate2
  Whisper command line client compatible with original OpenAI client based on CTranslate2.
  ☆1,116Updated 2 months ago
• Nexesenex / croco.cpp
  Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…
  ☆147Updated this week
• FastFlowLM / FastFlowLM
  Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
  ☆280Updated this week
• QuantiusBenignus / BlahST
  Input text from speech in any Linux window, the lean, fast and accurate way, using whisper.cpp OFFLINE. Speak with local LLMs via llama.c…
  ☆142Updated 2 months ago
• matatonic / openedai-speech
  An OpenAI API compatible text to speech server using Coqui AI's xtts_v2 and/or piper tts as the backend.
  ☆817Updated 8 months ago
• ROCm / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆63Updated 2 weeks ago
• TNTwise / rife-ncnn-vulkan
  RIFE, Real-Time Intermediate Flow Estimation for Video Frame Interpolation implemented with ncnn library
  ☆54Updated 3 months ago
• stduhpf / stable-diffusion.cpp
  Stable Diffusion and Flux in pure C/C++
  ☆21Updated 3 weeks ago
• l1na-forever / stable-diffusion-rocm-docker
  Stable Diffusion Docker image preconfigured for usage with AMD Radeon cards
  ☆138Updated last year
• amd / xdna-driver
  ☆474Updated last week
• styler00dollar / VapourSynth-RIFE-ncnn-Vulkan
  RIFE filter for VapourSynth
  ☆156Updated last month