Alternatives and similar repositories for CTranslate2-rocm:

Users that are interested in CTranslate2-rocm are comparing it to the libraries listed below

• ThomasBaruzier / gddr6-core-junction-vram-temps
  Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs
  ☆27Updated last month
• arlo-phoenix / bitsandbytes-rocm-5.6
  8-bit CUDA functions for PyTorch Rocm compatible
  ☆39Updated 9 months ago
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆460Updated 3 weeks ago
• jjziets / gddr6_temps
  Prometheus exporter for Linux​ based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.
  ☆16Updated 3 months ago
• lamikr / rocm_sdk_builder
  ☆164Updated this week
• theroyallab / tabbyAPI
  An OAI compatible exllamav2 API that's both lightweight and fast
  ☆733Updated this week
• Beinsezii / comfyui-amd-go-fast
  Simple monkeypatch to boost AMD Navi 3 GPUs
  ☆31Updated 8 months ago
• broncotc / bitsandbytes-rocm
  ☆37Updated last year
• mostlygeek / llama-swap
  transparent proxy server for llama.cpp's server to provide automatic model swapping
  ☆135Updated this week
• Nexesenex / croco.cpp
  Croco.Cpp is a 3rd party testground for KoboldCPP, a simple one-file way to run various GGML/GGUF models with KoboldAI's UI. (for Croco.C…
  ☆92Updated this week
• jim60105 / docker-whisperX
  Dockerfile for WhisperX: Automatic Speech Recognition with Word-Level Timestamps and Speaker Diarization (Dockerfile, CI image build and …
  ☆205Updated this week
• xor2k / gpu_undervolt
  ☆40Updated last year
• NeuralVox / StyleTTS2
  ☆90Updated 8 months ago
• kalomaze / koboldcpp
  My personal fork of koboldcpp where I hack in experimental samplers.
  ☆43Updated 8 months ago
• segurac / force-host-alloction-APU
  ☆44Updated 9 months ago
• synexo / subtitler
  A utility that uses Whisper to transcribe videos and various translation APIs to translate the transcribed text and save them as SRT (sub…
  ☆67Updated 4 months ago
• nktice / AMD-AI
  AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1
  ☆184Updated 2 months ago
• RomanKlimov / faster-whisper-acceleration
  Accelerating faster-whisper single file processing by multiprocessing through parallelization
  ☆51Updated last year
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆217Updated last month
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆126Updated this week
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆68Updated 3 months ago
• ulyssesrr / docker-rocm-xtra
  ROCm docker images with fixes/support for extra architectures, such as gfx803/gfx1010.
  ☆25Updated last year
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆116Updated this week
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆177Updated 8 months ago
• lmg-anon / mikupad
  LLM Frontend in a single html file
  ☆305Updated this week
• Isotr0py / pillow-jpegxl-plugin
  Pillow plugin for JPEG-XL, using Rust for bindings.
  ☆28Updated last week
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆50Updated 2 months ago
• QuantiusBenignus / BlahST
  Input text from speech in any Linux window, the lean, fast and accurate way, using whisper.cpp offline. Speak with local LLMs.
  ☆52Updated 2 months ago
• Vali-98 / XTTS-RVC-UI
  A Gradio UI for XTTSv2 and RVC.
  ☆156Updated 7 months ago
• absadiki / pywhispercpp
  Python bindings for whisper.cpp
  ☆203Updated 2 weeks ago