☆122May 11, 2026Updated 5 months ago
Alternatives and similar repositories for vllm-mlu
Users that are interested in vllm-mlu are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆60Mar 15, 2025Updated last year
- Community maintained hardware plugin for vLLM on MetaX GPU☆186Updated this week
- Efficient operation implementation based on the Cambricon Machine Learning Unit (MLU) .☆183Oct 10, 2026Updated 2 weeks ago
- This fork of BVLC/Caffe is dedicated to supporting Cambricon deep learning processor and improving performance of this deep learning fram…☆40May 15, 2020Updated 6 years ago
- vLLM Kunlun (vllm-kunlun) is a community-maintained hardware plugin designed to seamlessly run vLLM on the Kunlun XPU.☆480Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆10Aug 2, 2021Updated 5 years ago
- ☆33Apr 20, 2023Updated 3 years ago
- A flexible serving framework that delivers efficient and fault-tolerant LLM inference for clustered deployments.☆100Oct 22, 2026Updated last week
- CNStream is a streaming framework for building Cambricon machine learning pipelines http://forum.cambricon.com https://gitee.com/Solu…☆55Mar 21, 2025Updated last year
- Distributed SDDMM Kernel☆13Jul 8, 2022Updated 4 years ago
- ☆13Jun 11, 2024Updated 2 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆128Updated this week
- ☆79Dec 15, 2023Updated 2 years ago
- A novel temporal fusion framework for propelling autoregressive model inference☆11Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A supernode-native post-training engine for rapidly adapting and training LLMs & VLMs☆30Updated this week
- Community maintained hardware plugin for vLLM on Huawei Ascend☆3,036Updated this week
- Visualize the Expert Parallelism Load Balancer☆18Mar 15, 2025Updated last year
- Chinese Guide for Alveo Getting Started☆13May 18, 2020Updated 6 years ago
- A Triton-only attention backend for vLLM☆28Jul 14, 2026Updated 3 months ago
- A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Fou…☆1,613Updated this week
- ☆22Nov 6, 2025Updated 11 months ago
- [MLSys 2023] Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Models☆16May 5, 2023Updated 3 years ago
- Slides and exercises for persistent memory programming tutorial☆14Nov 14, 2022Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- xmservice☆10May 28, 2020Updated 6 years ago
- ☆11Jul 28, 2026Updated 3 months ago
- The 'missing header' for Chisel☆24Feb 5, 2026Updated 8 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆13Sep 29, 2026Updated last month
- [NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive☆79Aug 8, 2026Updated 2 months ago
- Cloud Native Distributed Nearest Neighbour Search☆15Jun 9, 2020Updated 6 years ago
- ☆13Sep 19, 2023Updated 3 years ago
- 基于 sgl-project/sglang 上游社区版本建设的 das 下游适配仓库，面向 hcu 平台进行功能适配与优化。☆47Updated this week
- FLOPS counter for all your GPU benchmarking needs☆13Aug 8, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆10Dec 7, 2024Updated last year
- Feature Selection in scRNA-seq☆11Sep 9, 2021Updated 5 years ago
- [EMNLP 2025 Findings] Familiarity-aware Evidence Compression for Retrieval Augmented Generation☆15Aug 20, 2025Updated last year
- ☆13Mar 28, 2025Updated last year
- Large Language Model Inference Acceleration: A Comprehensive Hardware Perspective☆21Jul 15, 2025Updated last year
- A lightweight design for computation-communication overlap.☆252Jan 20, 2026Updated 9 months ago
- NVIDIA Inference Xfer Library (NIXL)☆1,344Updated this week