Community maintained hardware plugin for vLLM on MetaX GPU
☆185Oct 23, 2026Updated last week
Alternatives and similar repositories for vLLM-metax
Users that are interested in vLLM-metax are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 沐曦-智能文档工作流方案致力于文档知识结构化领域，依托沐曦C系列GPU强大的训练与推理性能，使用多模态AI技术，构建了一套高效、精准的文档结构化解析流程☆18Jul 28, 2025Updated last year
- ☆16Aug 3, 2026Updated 2 months ago
- Fast and efficient attention method exploration and implementation.☆29Jul 6, 2026Updated 3 months ago
- ☆43Oct 16, 2026Updated 2 weeks ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆127Updated this week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆122May 11, 2026Updated 5 months ago
- vLLM Kunlun (vllm-kunlun) is a community-maintained hardware plugin designed to seamlessly run vLLM on the Kunlun XPU.☆480Oct 13, 2026Updated 2 weeks ago
- ☆26Jun 10, 2026Updated 4 months ago
- MXMACA入门materials☆24Jun 9, 2024Updated 2 years ago
- ☆29Oct 20, 2026Updated last week
- A vLLM plugin built on the FlagOS unified multi-chip backend.☆133Updated this week
- Community maintained hardware plugin for vLLM on Huawei Ascend☆3,029Updated this week
- ☆83Oct 23, 2026Updated last week
- ☆15Oct 16, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A QA system based on k8s-specific knowledge build on ChatGLM2-6B, serving by Ray.☆10Sep 14, 2023Updated 3 years ago
- Fast, multithreaded, AVX/FMA matrix multiplication kernel in C++ 17☆18Nov 28, 2018Updated 7 years ago
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆13May 16, 2023Updated 3 years ago
- Fast and memory-efficient exact attention☆137Oct 7, 2026Updated 3 weeks ago
- NVIDIA Inference Xfer Library (NIXL)☆1,341Updated this week
- Nano vLLM v1 engine☆15Aug 6, 2025Updated last year
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆931Updated this week
- Provides deploy scripts and CSI for Lustre.☆14Oct 23, 2026Updated last week
- This is the official **live** mirror of Ascend-native hardware plugin for ray☆16Jul 3, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Flexible and Pluggable Serving Engine for Diffusion LLMs☆158Jul 13, 2026Updated 3 months ago
- ☆28Updated this week
- A workload for deploying LLM inference services on Kubernetes☆312Updated this week
- InfiniCCL is a unified, cross-platform collective communication library designed for heterogeneous accelerator environments.☆21Updated this week
- FlagGems is an operator library for large language models implemented in the Triton Language.☆1,164Updated this week
- High-performance LLM operator library built on TileLang.☆202Updated this week
- helm repo add daocloud https://daocloud.github.io/dce-charts-repackage/☆13Updated this week
- Kubernetes APIServer 高性能代理组件，代理 APIServer 的 List 请求，其它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且，CKube 100% 兼容原生 kubectl 和 ku…☆19Sep 16, 2022Updated 4 years ago
- DLBlas: clean and efficient kernels☆45Oct 23, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This repo is used for archiving my notes, codes and materials of cs learning.☆103Sep 24, 2026Updated last month
- ☆11Oct 5, 2026Updated 3 weeks ago
- ☆380Updated this week
- Radix Tree KV Cache with Turn-Aware Growth☆12Jul 21, 2025Updated last year
- Offline optimization of your disaggregated Dynamo graph☆461Updated this week
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆27Apr 24, 2025Updated last year
- ☆11Sep 14, 2020Updated 6 years ago