FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs
☆71May 4, 2025Updated last year
Alternatives and similar repositories for vllm-rocm
Users that are interested in vllm-rocm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Triton for AMD MI25/50/60. Development repository for the Triton language and compiler☆34Dec 15, 2025Updated 7 months ago
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆433Feb 20, 2026Updated 5 months ago
- triton for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆48Dec 8, 2025Updated 7 months ago
- ML software (llama.cpp, ComfyUI, vLLM) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆294Updated this week
- llama.cpp-gfx906☆139Mar 22, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆443Apr 4, 2025Updated last year
- Sparc emulator☆11May 19, 2018Updated 8 years ago
- vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill☆34Nov 7, 2025Updated 8 months ago
- Bellcore MGR, from version 0.69☆25Feb 26, 2023Updated 3 years ago
- 基于RWKV模型的角色扮演，实际上是个改的妈都不认识的 RWKV_Role_Playing☆17Aug 17, 2023Updated 2 years ago
- 1CatV2 with TileLANG written FA-v100 and many goodies☆18Jul 15, 2026Updated 2 weeks ago
- Numerical experiments on Jacobi SVD algorithm☆10Jun 3, 2018Updated 8 years ago
- ☆58Oct 10, 2025Updated 9 months ago
- Compressed KV cache as cross-backend wire format for Metal + CUDA split inference over Thunderbolt 5☆16Apr 14, 2026Updated 3 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ThereminQ CLassiQ - QuantOPS : Orchestrate Qrack, Bonsai, Qimcifa and Tipsy in OpenCL, VCL and CUDA with an X WebUI☆13Jan 10, 2026Updated 6 months ago
- An F/OSS solution combining AI with Wikipedia knowledge via a RAG pipeline☆106Jan 12, 2025Updated last year
- This is a tutorial prepared for a summer school in Changsha in 2021☆10Jul 15, 2021Updated 5 years ago
- A free Windows-compatible Operating System☆24Apr 20, 2026Updated 3 months ago
- Transform your pdfs into anki flashcard with gpt☆12Jun 10, 2024Updated 2 years ago
- a Python3 library for ML modeling materials properties☆10Sep 15, 2019Updated 6 years ago
- IBM 5161 expansion chassis extender and receiver cards☆32Dec 29, 2023Updated 2 years ago
- Kit's open-sourced agent workspace 🦊 - SOUL.md, memory, knowledge, scripts☆20Apr 4, 2026Updated 3 months ago
- do some exercise☆15Dec 2, 2025Updated 7 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- vLLM fork for Tesla V100 (SM70) with AWQ 4-bit support, CUDA 12.8 build flow, and validated Qwen3.5 27B/35B deployment on multi-GPU V…☆557Jul 21, 2026Updated last week
- A poor man's density functional theory program☆14May 18, 2026Updated 2 months ago
- Pure lua implementation of utf8proc and a few more unicode utilities☆13Jun 11, 2015Updated 11 years ago
- LLM inference in C/C++☆29Updated this week
- The repository targets the OpenCL gemm function performance optimization. It compares several libraries clBLAS, clBLAST, MIOpenGemm, Inte…☆17Mar 28, 2019Updated 7 years ago
- Tries to UI development. Clone of https://www.perplexity.ai/☆11Sep 30, 2023Updated 2 years ago
- ☆33Updated this week
- Flexible C++ implementation of the RETE pattern matching algorithm, including a reasoner based on top of it.☆15Aug 13, 2021Updated 4 years ago
- ☆14Sep 4, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- (beta) Hindsight integration for pi coding agent (with queueing, past session ingestion, and a focus on best practices)☆20Jun 26, 2026Updated last month
- KTransformers 一键部署脚本☆60Apr 18, 2025Updated last year
- Fused BF16 Huffman GEMV Inference kernel☆22Apr 22, 2026Updated 3 months ago
- A library and CLI utilities for managing performance states of NVIDIA GPUs.☆37Oct 6, 2024Updated last year
- ☆54Jul 16, 2026Updated last week
- Code scanner to check for issues in prompts and LLM calls☆78Apr 6, 2025Updated last year
- A LinearOperator implementation for PyTorch☆18Jan 15, 2021Updated 5 years ago