A high-throughput and memory-efficient inference and serving engine for LLMs
☆127Oct 29, 2026Updated this week
Alternatives and similar repositories for vllm-musa
Users that are interested in vllm-musa are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- torch_musa is an open source repository based on PyTorch, which can make full use of the super computing power of MooreThreads graphics c…☆518Sep 23, 2026Updated last month
- Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models on MTGPU.☆37Oct 13, 2025Updated last year
- Fork from https://github.com/deepseek-ai/FlashMLA☆18Feb 26, 2025Updated last year
- MUSA Templates for Linear Algebra Subroutines☆50Updated this week
- AI-native long-form video studio with hidden storyboard orchestration and pluggable generation backends.☆18Oct 7, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels☆59Jun 5, 2026Updated 4 months ago
- Community maintained hardware plugin for vLLM on MetaX GPU☆185Oct 23, 2026Updated last week
- Agentman: A tool for building and managing AI agents☆20Jul 10, 2025Updated last year
- Implementation of DAC'22 paper: Hierarchical Memory-Constrained Operator Scheduling of Neural Architecture Search Networks.☆11Sep 5, 2022Updated 4 years ago
- A Python implementation of the AVO framework from arXiv:2603.24517.☆16Jun 1, 2026Updated 4 months ago
- A lightweight CuTe-based CUDA kernel for DuoAttention, optimized for large language model inference.☆12Dec 25, 2025Updated 10 months ago
- PipeWeave: Synergizing Analytical and Learning Models for Unified GPU Performance Prediction☆23Sep 2, 2026Updated last month
- SGLang Kunlun (sglang-kunlun) is a community-maintained hardware plugin designed to seamlessly run SGLang on the Kunlun XPU.☆62Oct 16, 2026Updated last week
- MUSA AI Tensor Engine☆24Oct 14, 2026Updated 2 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- DeepSeek-V3/R1 inference performance simulator☆199Mar 27, 2025Updated last year
- 能够远程办公（work from home）的公司名单☆16Mar 2, 2022Updated 4 years ago
- ☆21Sep 2, 2026Updated last month
- This repository contains the code for the ICLR 2026 paper “DASH: Deterministic Attention Scheduling for High-Throughput Reproducible LLM …☆15Jun 23, 2026Updated 4 months ago
- The quantization of CNN/LSTM☆11Mar 26, 2017Updated 9 years ago
- 东南大学的科技读写课的期末作业专利申请书的LaTeX模板☆13Jun 17, 2022Updated 4 years ago
- ☆10Nov 18, 2024Updated last year
- ☆15Apr 15, 2022Updated 4 years ago
- ☆122May 11, 2026Updated 5 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This is the official **live** mirror of Ascend-native hardware plugin for ray☆16Jul 3, 2026Updated 3 months ago
- llm theoretical performance analysis tools and support params, flops, memory and latency analysis.☆124Jul 11, 2025Updated last year
- ☆156Mar 4, 2025Updated last year
- Offline optimization of your disaggregated Dynamo graph☆461Updated this week
- ☆1,081Updated this week
- RISCV C and Triton AI-Benchmark☆26Jan 28, 2026Updated 9 months ago
- A from-scratch Prefill/Decode disaggregation inference engine for LLMs☆163May 10, 2026Updated 5 months ago
- Community maintained hardware plugin for vLLM on Huawei Ascend☆3,029Updated this week
- SmolVLM2 on the RK3588 NPU☆13Jul 25, 2026Updated 3 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Interactive, single-file web animations for visualizing LLM inference systems.☆45Aug 6, 2026Updated 2 months ago
- 🔥 local cache for k8s apiserver 🔥☆13Dec 4, 2020Updated 5 years ago
- APEX+ is an LLM Serving Simulator☆51Jun 16, 2025Updated last year
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆1,875Sep 24, 2026Updated last month
- ☆18Nov 4, 2024Updated last year
- Prototyp MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism☆35Apr 4, 2025Updated last year
- ☆28Oct 4, 2026Updated 3 weeks ago