FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs
☆66May 4, 2025Updated 11 months ago
Alternatives and similar repositories for vllm-rocm
Users that are interested in vllm-rocm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Triton for AMD MI25/50/60. Development repository for the Triton language and compiler☆32Dec 15, 2025Updated 4 months ago
- triton for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆45Dec 8, 2025Updated 4 months ago
- ML software (llama.cpp, ComfyUI, vLLM) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆157Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆117Updated this week
- LLM inference in C/C++☆21Apr 9, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- a Python3 library for ML modeling materials properties☆10Sep 15, 2019Updated 6 years ago
- do some exercise☆14Dec 2, 2025Updated 4 months ago
- The repository targets the OpenCL gemm function performance optimization. It compares several libraries clBLAS, clBLAST, MIOpenGemm, Inte…☆17Mar 28, 2019Updated 7 years ago
- ☆14Sep 4, 2024Updated last year
- Tries to UI development. Clone of https://www.perplexity.ai/☆11Sep 30, 2023Updated 2 years ago
- Canonical miniKanren implementation in Racket☆18Nov 17, 2016Updated 9 years ago
- A VQE-based quantum chemistry simulator☆13Jun 20, 2020Updated 5 years ago
- ☆17Oct 15, 2023Updated 2 years ago
- Training Hierarchical Reasoning Models for next-token prediction.☆38Aug 7, 2025Updated 8 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Libraries integrating migraphx with pytorch☆17Dec 27, 2025Updated 3 months ago
- Supporting code for "LLMs for your iPhone: Whole-Tensor 4 Bit Quantization"☆11Mar 31, 2024Updated 2 years ago
- Raptor is a modern, fast, and easy-to-use system for building disk images, bootable isos, containers and much more, from a simple, Docker…☆39Feb 10, 2026Updated 2 months ago
- ☆11Nov 27, 2025Updated 4 months ago
- ☆15May 14, 2024Updated last year
- vllm混合推理扩展插件,支持多NUMA混合推理,单卡推理Qwen3-Next模型可达1000+ prefill☆32Nov 7, 2025Updated 5 months ago
- Script Execution service☆12Nov 21, 2016Updated 9 years ago
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆67Updated this week
- Modern self-hosting panel.☆15Jan 1, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A matlab implementation of density functional theory, for demonstrative purpose☆21Sep 23, 2017Updated 8 years ago
- oyc-lang 自制编程语言☆11Apr 21, 2018Updated 7 years ago
- ☆12Apr 29, 2021Updated 4 years ago
- InstallAware© APPX Library for Microsoft's Desktop Bridge☆15Dec 14, 2016Updated 9 years ago
- Simple Interprocess Plugins for Go☆17Mar 24, 2020Updated 6 years ago
- sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems☆124Updated this week
- An open-source session replay tool for single-page applications that uses AI analysis, aggregated trends, and a RAG chatbot to help devel…☆11Jan 23, 2026Updated 2 months ago
- ☆12Feb 24, 2022Updated 4 years ago
- An OpenAI API compatible FastAPI server that sits on top of the Anemll repo. Tested with Open WebUI.☆20Jan 21, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Efficient Blind Deblurring under High Noise Levels (with online demo)☆27Nov 4, 2022Updated 3 years ago
- Collection of tips for using textgen in various ways☆19Aug 30, 2024Updated last year
- a tiny, portable, stackless coroutine in C++11☆11May 17, 2023Updated 2 years ago
- A NativeScript Range Seek Bar widget.☆10Jan 14, 2023Updated 3 years ago
- ☆10May 5, 2021Updated 4 years ago
- Repository for the course "JavaScript Object Oriented Programming"☆11Jun 30, 2019Updated 6 years ago
- A wayland compositor with an epic tech stack☆11Aug 28, 2020Updated 5 years ago