FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs
☆71May 4, 2025Updated last year
Alternatives and similar repositories for vllm-rocm
Users that are interested in vllm-rocm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Triton for AMD MI25/50/60. Development repository for the Triton language and compiler☆36Dec 15, 2025Updated 10 months ago
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆436Feb 20, 2026Updated 8 months ago
- triton for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆48Dec 8, 2025Updated 10 months ago
- ☆32Sep 30, 2026Updated last month
- ML software (llama.cpp, ComfyUI, Strata, Maya, ...) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆376Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Unlock tool for the NVIDIA CMP 170HX (GA100) mining card. Restores full A100 compute throughput by exploiting the Falcon BootROM .fwsigna…☆57Jul 30, 2026Updated 3 months ago
- A database of knowledge around inference & training on GFX906 GPUs https://skyne98.github.io/wiki-gfx906/☆19Feb 21, 2026Updated 8 months ago
- DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallel…☆118Aug 13, 2026Updated 2 months ago
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆50Oct 28, 2026Updated last week
- Guidances for Test setup of 8 AMD MI50 32GB (LLM)☆14Oct 22, 2025Updated last year
- Optimized build of llama.cpp for gfx906/Vega20.☆24Updated this week
- ☆65Aug 6, 2026Updated 3 months ago
- Open source cooling solution for the **AMD Radeon Instinct MI50** (Vega 20).☆18May 29, 2026Updated 5 months ago
- Modified for AMD MI50 GPUs | A high-throughput and memory-efficient inference and serving engine for LLMs☆15Mar 2, 2026Updated 8 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆30May 12, 2026Updated 5 months ago
- glm-5.2 on too many 64 / 80 GB A100's☆22Sep 9, 2026Updated last month
- 双 SM80 / CMP 170HX 的 Qwen3.8-Flash-Next 社区 vLLM：NVIDIA NVFP4、GDS、TEP2、MTP6，支持 1～10 并发，词表与 PCIe 通信优化。中英文部署与可构建源码。☆28Oct 15, 2026Updated 3 weeks ago
- forked from vllm-project/flash-attention☆74May 9, 2026Updated 5 months ago
- 1CatV2 with TileLANG written FA-v100 and many goodies☆20Jul 15, 2026Updated 3 months ago
- 🚿 Llaminar: an LLM inferencing engine in C++.☆47Updated this week
- DeepSeek-V4.1-Flash (764B) on 4×CMP 170HX: PP4 + shadow KV + EXL3 2bpw + DSpark + 512k ctx + native vision — patches, recipes, acceptance…☆15Sep 29, 2026Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆38Updated this week
- ☆59Oct 10, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Compressed KV cache as cross-backend wire format for Metal + CUDA split inference over Thunderbolt 5☆15Apr 14, 2026Updated 6 months ago
- 使用nvidia oam转接卡将intel gaudi2转接到pcie并在ubuntu下正常驱动和使用的指南☆29Updated this week
- An F/OSS solution combining AI with Wikipedia knowledge via a RAG pipeline☆110Jan 12, 2025Updated last year
- A Rust inference engine currently targeting AMD R9700 GPU's. buymeacoffee.com/bkuyper☆16Updated this week
- Interface between Openfermion and Dirac to perform relativistic quantum chemistry calculations simulated on a quantum computer☆14Aug 12, 2022Updated 4 years ago
- Single-request LLM serving recipes, patches, and benchmarks for modified RTX 2080 Ti 22GB / SM75 systems☆97Jun 10, 2026Updated 4 months ago
- 1Cat Studio: unified vLLM workbench, Codex Agent and creative canvas☆15Updated this week
- Validate the usable size of your local LLM cache under pressure☆12Sep 26, 2026Updated last month
- Run DeepSeek-V4.1-Flash / DeepSeek-V4-Flash and GLM-5.3-Flash on SM89 (Ada / RTX 4090) and SM120 (RTX PRO 6000) with vLLM☆203Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Mining CryptoNight Haven on the Varium C1100☆10Apr 1, 2022Updated 4 years ago
- A [Genshin Impact] artifacts enhancement predictor. 一个【原神】圣遗物强化预测工具。☆13May 18, 2022Updated 4 years ago
- Qwen3.8-Flash-Next (W4A16) on 2x CMP 170HX: 110 tok/s decode, 7K prefill, 800 tok/s @ 23 concurrent - runs on 38 GB home RAM, no pinned m…☆20Sep 18, 2026Updated last month
- setup A8 development environment.☆12Apr 25, 2017Updated 9 years ago
- AMD Radeon 9700 AI PRO RDNA multi GPU Tools for llm/vLLM inference, tuning, overclocking, undervolting and LLM models benchmarking☆17Aug 15, 2026Updated 2 months ago
- a Python3 library for ML modeling materials properties☆10Sep 15, 2019Updated 7 years ago
- DeepSeek-V4.1-Flash-1017 (552B MoE + 196B Engram) on 2x RTX 3090 + 128 GB RAM. Rust + CUDA, T16 quantization. 40+ tok/s measured with exp…☆93Updated this week