A vLLM plugin built on the FlagOS unified multi-chip backend.
☆136Nov 2, 2026Updated this week
Alternatives and similar repositories for vllm-plugin-FL
Users that are interested in vllm-plugin-FL are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Jul 18, 2026Updated 3 months ago
- FlagCX is a scalable and adaptive cross-chip communication library.☆260Updated this week
- FlagGems is an operator library for large language models implemented in the Triton Language.☆1,165Updated this week
- FlagOS skills for model deployment, HW adaptation, train&infer, eval, kernel dev and perf tuning☆22Jul 18, 2026Updated 3 months ago
- 基于 vLLM 上游社区版本建设的 das 插件仓库，为 hcu 平台提供功能适配、兼容支持与性能优化。☆28Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Sharded, differentiable quantum simulation and training in PyTorch, reaching domestic accelerators through FlagOS.☆36Updated this week
- FlagGems-sglang is part of FlagOS. It is a high-performance operator library designed for multiple hardware backends.☆20Updated this week
- Next-Generation AI-Assisted Kernel Engineering for Multi-Chip Systems☆89Sep 28, 2026Updated last month
- ☆14Aug 6, 2025Updated last year
- AI Cluster Observability & Troubleshooting Toolkit. Powered by SII & Infrawaves.☆40Apr 29, 2026Updated 6 months ago
- 基于 sgl-project/sglang 上游社区版本建设的 das 下游适配仓库，面向 hcu 平台进行功能适配与优化。☆47Updated this week
- The official implementation of NOSA (EMNLP 2026 main)☆19Sep 28, 2026Updated last month
- STL容器，vector/list/stack/queue/rb_tree/hash_table/map/set，UnionFindSet/BitMap/BloomFilter☆10Aug 9, 2018Updated 8 years ago
- 🔥 [ICML'26] ParisKV: Fast and Drift-Robust KV-Cache Retrieval for Long-Context LLMs☆37Aug 14, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A Flexible Framework for Comprehensive Multimodal Model Evaluation☆109Apr 21, 2026Updated 6 months ago
- ☆135Updated this week
- Community maintained hardware plugin for vLLM on MetaX GPU☆186Updated this week
- AI Infra / 机器学习系统面经（305 题）☆48May 5, 2026Updated 5 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆129Updated this week
- User facing skill definitions for PyTorch users☆12Sep 28, 2026Updated last month
- Official Implementation of "ComAct: Reframing Professional Software Manipulation via COM-as-Action Paradigm".☆13Jul 1, 2026Updated 4 months ago
- 先进编译实验室的个人主页☆270Oct 15, 2025Updated last year
- ESP32 Cam RTSP with Tensorflow Object Detection☆10May 3, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Community maintained hardware plugin for vLLM on Huawei Ascend☆3,039Updated this week
- llm-d-batch-gateway is a standalone, backend-agnostic, OpenAI-compatible batch API and processing engine☆28Updated this week
- A from-scratch Prefill/Decode disaggregation inference engine for LLMs☆163May 10, 2026Updated 5 months ago
- Position-independent caching for hybrid-attention LLM serving.☆20Jul 27, 2026Updated 3 months ago
- A curated collection of Claude Code agent skills that accelerate the entire vLLM development lifecycle.☆25Updated this week
- This is a cross-chip platform collection of operators and a unified neural network library.☆17Nov 3, 2023Updated 2 years ago
- ☆19Mar 4, 2025Updated last year
- A Triton JIT runtime and ffi provider in C++☆41Sep 24, 2026Updated last month
- Multi-market stock analysis, screening & backtesting plugin for AI agents — 39 tools + 20 strategy skills across A/HK/US/JP/KR/TW markets…☆37Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- d.run website☆18Updated this week
- ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)☆54Dec 17, 2024Updated last year
- ☆28Updated this week
- ☆52Updated this week
- 📚 An educational, step-by-step implementation of LLM KV cache reuse — learn prefix caching, chunk keys, storage & eviction, from pure Py…☆25Updated this week
- Equal Loudness Filter☆11Mar 4, 2019Updated 7 years ago
- [ICML 2024] Serving LLMs on heterogeneous decentralized clusters.☆37May 6, 2024Updated 2 years ago