☆18Nov 17, 2026Updated this week
Alternatives and similar repositories for FlagGems-vllm
Users that are interested in FlagGems-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- FlagTree IR is forked from microsoft/triton-shared, which is a Shared Middle-Layer for Triton Compilation. It is used for FlagTree.☆11Nov 3, 2026Updated 2 weeks ago
- A Triton JIT runtime and ffi provider in C++☆41Nov 4, 2026Updated 2 weeks ago
- Community-maintained hardware plugin for vLLM on Iluvatar GPU.☆20Nov 9, 2026Updated last week
- Community maintained hardware plugin for vLLM on T-Head SAIL☆30Updated this week
- Quickly switch your Visual Studio Code editor font.☆17May 9, 2026Updated 6 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆24Sep 16, 2026Updated 2 months ago
- FlagTree is a unified compiler supporting multiple AI chip backends for custom Deep Learning operations, which is forked from triton-lang…☆386Updated this week
- 基于 vLLM 上游社区版本建设的 das 插件仓库,为 hcu 平台提供功能适配、兼容支持与性能优化。☆35Updated this week
- Repository for isQ quantum program compiler.☆15Oct 16, 2023Updated 3 years ago
- MUSA AI Tensor Engine☆26Updated this week
- Linpack: configuration, install, optimization☆16Jul 3, 2019Updated 7 years ago
- A collection of memory efficient attention operators implemented in the Triton language.☆327Updated this week
- FlagGems is an operator library for large language models implemented in the Triton Language.☆1,182Updated this week
- 迷你定向网页抓取器☆15Aug 29, 2016Updated 10 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- FlagGems-sglang is part of FlagOS. It is a high-performance operator library designed for multiple hardware backends.☆21Updated this week
- A vLLM plugin built on the FlagOS unified multi-chip backend.☆143Updated this week
- Evaluation scripts for the Open TTS Leaderboard: https://huggingface.co/spaces/hf-audio/open_tts_leaderboard☆15Updated this week
- ML framework featuring compile time checks and accelerated by a JIT compiler.☆10Mar 19, 2026Updated 7 months ago
- fused MoE kernel in Candle backend☆14Feb 3, 2026Updated 9 months ago
- FlashFunAsr: A lightweight vLLM implementation built from scratch for FunASR nano☆12Jan 5, 2026Updated 10 months ago
- A survey of modern quantization formats (e.g., MXFP8, NVFP4) and inference optimization tools (e.g., TorchAO, GemLite), illustrated throu…☆12Nov 11, 2025Updated last year
- A buggy cuTile language service.☆11Jan 13, 2026Updated 10 months ago
- Running LLaMA 3 with Rust.☆10May 21, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- 更纯粹、更高压缩率的Tokenizer in Rust☆14Sep 7, 2026Updated 2 months ago
- Graph model execution API for Candle☆19Jul 27, 2025Updated last year
- Examples from the Learning Burn book.☆17Oct 14, 2026Updated last month
- ☆11Jul 21, 2026Updated 3 months ago
- ☆20Oct 5, 2025Updated last year
- Transparent query, pointer and path descriptors for JSON☆16Dec 5, 2022Updated 3 years ago
- Multi-tenant streaming ASR server for Qwen3-ASR (vLLM AsyncLLMEngine). Drop-in replacement for qwen-asr-demo-streaming.☆14Nov 3, 2026Updated 2 weeks ago
- The Bytepiece Tokenizer Implemented in Rust.☆15Nov 28, 2023Updated 2 years ago
- Claude Code agent skills for writing optimized Triton GPU kernels☆16Mar 6, 2026Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- BibJSON spec and website☆20Mar 19, 2015Updated 11 years ago
- Learn DeepInfer through a small, runnable inference engine. Follow the code on CPU, then run real Qwen3.5 models on Ascend 910C.☆30Oct 25, 2026Updated 3 weeks ago
- Example code for calling AWS Lambda function to send email on S3 bucket event☆13Feb 26, 2015Updated 11 years ago
- A Rust crate offering similar functionality to the Python transformers package using Candle.☆15Nov 19, 2024Updated last year
- A Feishu/Lark AI agent bot☆16Feb 27, 2026Updated 8 months ago
- ☆12Nov 12, 2024Updated 2 years ago
- An open lab for DeepInfer systems research, correctness validation, and end-to-end optimization☆31Oct 28, 2026Updated 3 weeks ago
Are these results useful?