FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs
☆70May 4, 2025Updated last year
Alternatives and similar repositories for vllm-rocm
Users that are interested in vllm-rocm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆435Feb 20, 2026Updated 7 months ago
- triton for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆48Dec 8, 2025Updated 10 months ago
- llama.cpp-gfx906☆145Aug 23, 2026Updated last month
- ☆446Apr 4, 2025Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs - Optimized for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI…☆92Oct 8, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A database of knowledge around inference & training on GFX906 GPUs https://skyne98.github.io/wiki-gfx906/☆18Feb 21, 2026Updated 7 months ago
- LLM inference in C/C++☆64Updated this week
- ☆29May 12, 2026Updated 5 months ago
- vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill☆34Nov 7, 2025Updated 11 months ago
- ☆105Dec 29, 2020Updated 5 years ago
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆44Sep 29, 2026Updated 2 weeks ago
- 1CatV2 with TileLANG written FA-v100 and many goodies☆20Jul 15, 2026Updated 3 months ago
- Code and data for Teddy https://arxiv.org/abs/2001.05171.☆15Jun 21, 2022Updated 4 years ago
- Agnost GitOps Helm charts☆13Dec 9, 2025Updated 10 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- LLM inference in C/C++☆30Sep 25, 2026Updated 3 weeks ago
- Tries to UI development. Clone of https://www.perplexity.ai/☆11Sep 30, 2023Updated 3 years ago
- ☆12Updated this week
- The repository targets the OpenCL gemm function performance optimization. It compares several libraries clBLAS, clBLAST, MIOpenGemm, Inte…☆18Mar 28, 2019Updated 7 years ago
- V100 / SM70-focused vLLM engineering fork for modern LLM inference.☆1,340Updated this week
- Gluetun-Sync is an open-source utility designed to automatically update your services when the NAT port changes in Gluetun VPN☆12Sep 25, 2024Updated 2 years ago
- KTransformers 一键部署脚本☆60Apr 18, 2025Updated last year
- A LinearOperator implementation for PyTorch☆18Jan 15, 2021Updated 5 years ago
- MANO hand models in MJCF format for MuJoCo simulation.☆58Jul 29, 2026Updated 2 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- AI plays Doom — pit Vision Language Models against demons and each other. Solo scenarios, deathmatch arena, 1-4 agents with any OpenAI-co…☆21Mar 12, 2026Updated 7 months ago
- ☆61Sep 14, 2026Updated last month
- LM inference server implementation based on *.cpp.☆292Nov 24, 2025Updated 10 months ago
- SelfDB-mini is a minimal implementation of [SelfDB](https://github.com/Selfdb-io) with only the essential features: FastAPI backend, Reac…☆26Dec 15, 2025Updated 10 months ago
- ☆48Aug 11, 2026Updated 2 months ago
- Agent skills for mobile app paid growth powered by real-time data with APPEEKY MCP.☆73Aug 23, 2026Updated last month
- 基于PlayWithMe_JS二次开发的纯前端弹幕展示板，纯前端 H5 + ES6 + CSS3 实现☆32Apr 8, 2023Updated 3 years ago
- HTML rendering with `lit-html` for Stimulus Controllers.☆14Oct 6, 2023Updated 3 years ago
- A small collection of Quantum Phase Estimation algorithms coded in python using IBM's qiskit library.☆12Nov 25, 2021Updated 4 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Verified Qwen3.8 Flash-Next GGUF recipe for one NVIDIA DGX Spark or ASUS Ascent GX10☆61Updated this week
- ☆22Oct 1, 2024Updated 2 years ago
- Example of creating a user at runtime for a dynamic Docker image☆13Feb 2, 2023Updated 3 years ago
- A pi extension with a single tool: execute, running TypeScript in a persistent Bun evaluator. Files, shell, and subagents are expressed a…☆85Aug 18, 2026Updated last month
- RAIL wireless applications. Go to https://github.com/SiliconLabs/application_examples☆13Updated this week
- ☆41Aug 16, 2026Updated 2 months ago
- A matlab implementation of density functional theory, for demonstrative purpose☆21Sep 23, 2017Updated 9 years ago