FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs
☆70May 4, 2025Updated last year
Alternatives and similar repositories for vllm-rocm
Users that are interested in vllm-rocm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Triton for AMD MI25/50/60. Development repository for the Triton language and compiler☆34Dec 15, 2025Updated 6 months ago
- triton for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆48Dec 8, 2025Updated 7 months ago
- LLM inference in C/C++☆27Updated this week
- Running Whisper, some LLM and Functionary on an Instinct Mi50 for HomeAssistant☆17Mar 9, 2025Updated last year
- ☆14Sep 4, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Training Hierarchical Reasoning Models for next-token prediction.☆40Aug 7, 2025Updated 11 months ago
- vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill☆32Nov 7, 2025Updated 8 months ago
- iDRAC Redfish API client library written in Go.☆13Sep 5, 2023Updated 2 years ago
- Script Execution service☆12Nov 21, 2016Updated 9 years ago
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆71Apr 16, 2026Updated 2 months ago
- ☆10Aug 13, 2012Updated 13 years ago
- Modern self-hosting panel.☆15Jan 1, 2025Updated last year
- Automated LLM novelist☆46Apr 11, 2024Updated 2 years ago
- Example project that demonstrates how to generate NSString constants for Storyboard identifiers.☆30Oct 1, 2014Updated 11 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆20Jul 26, 2023Updated 2 years ago
- Library for Sensirion SHT1x & SHT7x family temperature and humidity sensors☆12Dec 25, 2018Updated 7 years ago
- Zunda: Japanese Enhanced Modality Analyzer client for Python.☆10Nov 30, 2019Updated 6 years ago
- An open-source session replay tool for single-page applications that uses AI analysis, aggregated trends, and a RAG chatbot to help devel…☆11Jan 23, 2026Updated 5 months ago
- An OpenAI API compatible FastAPI server that sits on top of the Anemll repo. Tested with Open WebUI.☆21Jan 21, 2026Updated 5 months ago
- Karaoke lyrics plugins for Flutter☆10Apr 30, 2022Updated 4 years ago
- A simple wrapper or termios(3) for Ruby.☆45Dec 15, 2020Updated 5 years ago
- A port of the RWKV v7 language model, implemented with the Burn deep learning framework☆14Jun 9, 2025Updated last year
- A NativeScript Range Seek Bar widget.☆10Jan 14, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆10May 5, 2021Updated 5 years ago
- Repository for the course "JavaScript Object Oriented Programming"☆11Jun 30, 2019Updated 7 years ago
- Proxy local server to public network. (include server and client)☆19Jul 21, 2025Updated 11 months ago
- ☆13Dec 26, 2022Updated 3 years ago
- GraphQL WebSocket Network Interface for Apollo Client☆13Jun 17, 2024Updated 2 years ago
- repository to manage document-based translation with OmegaT☆18Nov 1, 2024Updated last year
- match function that match token(形態素解析) with sentence.☆15Aug 23, 2022Updated 3 years ago
- ☆11Jul 15, 2015Updated 10 years ago
- hopfield☆30Oct 8, 2021Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆13Jun 3, 2023Updated 3 years ago
- A vue component sandbox that is quick and easy to use.☆10Dec 15, 2022Updated 3 years ago
- A NativeScript Label that supports text shadow.☆12Jan 4, 2023Updated 3 years ago
- A Dart-only package that creates, parses, and handles LRC, which is a format that stores song lyrics.☆14Aug 15, 2024Updated last year
- convert chinese, japanese 簡繁日漢字轉換☆14Mar 12, 2025Updated last year
- ☆10Sep 15, 2024Updated last year
- KuaiSearch PERKS☆12Nov 16, 2021Updated 4 years ago