☆132Oct 26, 2026Updated this week
Alternatives and similar repositories for MetaInfer
Users that are interested in MetaInfer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆24Oct 3, 2026Updated 3 weeks ago
- A model-agnostic GPU runtime for shipping models as verified programs.☆145Updated this week
- An Open Compiler Harness for Agentic GPU Programming☆183Oct 22, 2026Updated last week
- ☆25Sep 28, 2026Updated last month
- ☆23Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Breakable CUDA graph capture for PyTorch - capture compatible regions as CUDA graphs while running incompatible operations eagerly betwee…☆30Oct 8, 2026Updated 3 weeks ago
- A curated collection of Claude Code agent skills that accelerate the entire vLLM development lifecycle.☆25Updated this week
- An end-to-end agent project for GPU kernel implementation, analysis, profiling, and iterative optimization. It helps an agent turn PyTorc…☆203Updated this week
- 基于 sgl-project/sglang 上游社区版本建设的 das 下游适配仓库，面向 hcu 平台进行功能适配与优化。☆47Updated this week
- SGLang Kunlun (sglang-kunlun) is a community-maintained hardware plugin designed to seamlessly run SGLang on the Kunlun XPU.☆62Oct 16, 2026Updated 2 weeks ago
- Nano vLLM Triton☆14Aug 27, 2025Updated last year
- ☆1,089Updated this week
- Slow-Fast Inference: Training-free Inference Acceleration via Within-sentence Support Stability☆19Sep 2, 2026Updated last month
- 双 SM80 / CMP 170HX 的 Qwen3.8-Flash-Next 社区 vLLM：NVIDIA NVFP4、GDS、TEP2、MTP6，支持 1～10 并发，词表与 PCIe 通信优化。中英文部署与可构建源码。☆28Oct 15, 2026Updated 2 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A small, readable inference engine inspired by DeepInfer. CPU first, built for learning.☆17Oct 20, 2026Updated last week
- Building the Virtuous Cycle for AI-driven LLM Systems☆301Sep 25, 2026Updated last month
- A vLLM plugin built on the FlagOS unified multi-chip backend.☆133Updated this week
- fused MoE kernel in Candle backend☆14Feb 3, 2026Updated 8 months ago
- Auto-tuning for vllm. Getting the best performance out of your LLM deployment (vllm+guidellm+optuna)☆65Sep 25, 2026Updated last month
- Claude Code agent skills for writing optimized Triton GPU kernels☆15Mar 6, 2026Updated 7 months ago
- Can AI Agents Build Bespoke Systems?☆124Updated this week
- TokenSpeed is a speed-of-light LLM inference engine.☆2,830Updated this week
- ☆14Feb 18, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- The best rtl_uart in github! This is a UART design based on AXI Stream/Ready Vallid protocol. Support parameterized data bit width, clock…☆12May 8, 2025Updated last year
- Graph model execution API for Candle☆19Jul 27, 2025Updated last year
- NInfer SM80 port for NVIDIA CMP 170HX☆29Aug 22, 2026Updated 2 months ago
- A linker for partial GPU kernels.☆38Updated this week
- Agentic Kernel Optimization — advanced & eXtensible: a closed-loop, campaign-based multi-agent system for optimizing GPU kernels (benchma…☆84Sep 15, 2026Updated last month
- Multi-tenant streaming ASR server for Qwen3-ASR (vLLM AsyncLLMEngine). Drop-in replacement for qwen-asr-demo-streaming.☆14Jun 8, 2026Updated 4 months ago
- ☆43Updated this week
- AutoFDO tutorial☆22Jul 5, 2018Updated 8 years ago
- FlagGems is an operator library for large language models implemented in the Triton Language.☆1,165Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆11Oct 22, 2026Updated last week
- Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2☆729Updated this week
- Datanlord's RDMA nic driver☆13Sep 12, 2024Updated 2 years ago
- DROB (Dynamic Rewriter and Optimizer of Binary code)☆26Feb 19, 2020Updated 6 years ago
- A PyTorch native library for training speculative decoding models☆266Updated this week
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆1,880Sep 24, 2026Updated last month
- Kernel Design Agents (KDA) is a agent-centric workflow to write high-performance CUDA Kernels.☆1,505Oct 19, 2026Updated last week