Community maintained hardware plugin for vLLM on MetaX GPU
☆192Nov 17, 2026Updated this week
Alternatives and similar repositories for vLLM-metax
Users that are interested in vLLM-metax are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MetaX Embodied AI Simulation Solution☆14Jun 18, 2025Updated last year
- 沐曦-智能文档工作流方案致力于文档知识结构化领域,依托沐曦C系列GPU强大的训练与推理性能,使用多模态AI技术,构建了一套高效、精准的文档结构化解析流程☆18Jul 28, 2025Updated last year
- ☆16Aug 3, 2026Updated 3 months ago
- Fast and efficient attention method exploration and implementation.☆29Jul 6, 2026Updated 4 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆131Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆122May 11, 2026Updated 6 months ago
- ☆27Jun 10, 2026Updated 5 months ago
- A vLLM plugin built on the FlagOS unified multi-chip backend.☆144Updated this week
- vLLM Kunlun (vllm-kunlun) is a community-maintained hardware plugin designed to seamlessly run vLLM on the Kunlun XPU.☆486Updated this week
- ☆44Nov 6, 2026Updated last week
- MXMACA入门materials☆24Jun 9, 2024Updated 2 years ago
- ☆153Updated this week
- ☆30Nov 9, 2026Updated last week
- Community maintained hardware plugin for vLLM on Huawei Ascend☆3,109Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A QA system based on k8s-specific knowledge build on ChatGLM2-6B, serving by Ray.☆10Sep 14, 2023Updated 3 years ago
- 14 basic topics for VEGA64 performance optmization☆66Mar 18, 2021Updated 5 years ago
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆13May 16, 2023Updated 3 years ago
- Fast, multithreaded, AVX/FMA matrix multiplication kernel in C++ 17☆18Nov 28, 2018Updated 7 years ago
- ☆17Nov 12, 2026Updated last week
- Fast and memory-efficient exact attention☆138Updated this week
- Fork from https://github.com/deepseek-ai/FlashMLA☆18Feb 26, 2025Updated last year
- Nano vLLM v1 engine☆15Aug 6, 2025Updated last year
- NVIDIA Inference Xfer Library (NIXL)☆1,369Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆35Updated this week
- CCKS2023-PromptCBLUE: Code implement of TianChi completition☆21Feb 27, 2024Updated 2 years ago
- Provides deploy scripts and CSI for Lustre.☆13Oct 23, 2026Updated 3 weeks ago
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆963Updated this week
- DocAPI is a Python package that automatically generates API documentation using LLMs. It currently supports Flask and Django frameworks.☆11Jul 8, 2025Updated last year
- ☆19Updated this week
- ☆147Updated this week
- 书生实战营第六期打榜数据集测评方案☆12Mar 17, 2026Updated 8 months ago
- Flexible and Pluggable Serving Engine for Diffusion LLMs☆158Jul 13, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆13Aug 1, 2026Updated 3 months ago
- InfiniCCL is a unified, cross-platform collective communication library designed for heterogeneous accelerator environments.☆21Nov 12, 2026Updated last week
- MPI Code Generation through Domain-Specific Language Models☆16Nov 19, 2024Updated 2 years ago
- A workload for deploying LLM inference services on Kubernetes☆316Updated this week
- helm repo add daocloud https://daocloud.github.io/dce-charts-repackage/☆13Updated this week
- Kubernetes APIServer 高性能代理组件,代理 APIServer 的 List 请求,其它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且,CKube 100% 兼容原生 kubectl 和 ku…☆19Sep 16, 2022Updated 4 years ago
- FlagGems is an operator library for large language models implemented in the Triton Language.☆1,183Updated this week
Are these results useful?