SGLang is a fast serving framework for large language models and vision language models.
☆34Oct 30, 2026Updated this week
Alternatives and similar repositories for sglang
Users that are interested in sglang are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- CUDA Graph runtime tensor debugging utilities for PyTorch☆18Jul 12, 2026Updated 3 months ago
- ☆307Sep 5, 2026Updated last month
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆13Nov 23, 2024Updated last year
- Flash-GMM, a memory-efficient GPU kernel that unlocks GMM soft clustering at billion-scale☆25Sep 30, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Debug print operator for cudagraph debugging☆18Aug 2, 2024Updated 2 years ago
- Handwritten GEMM using Intel AMX (Advanced Matrix Extension)☆17Jan 11, 2025Updated last year
- ☆10Dec 6, 2022Updated 3 years ago
- Code and reproducibility artifacts for reconstructing megakernel persistence with CUDA PDL☆26Aug 5, 2026Updated 2 months ago
- VNEC: A Vectorized Non-Empty Column Format for SpMV on cross-platform multicore CPUs☆10Feb 6, 2024Updated 2 years ago
- Dist-MoE implements Speed-of-Light distributed Mixture-of-Experts forward and backward kernels. They are highly optimized and fused comm-…☆68Updated this week
- ☆118Aug 5, 2026Updated 2 months ago
- Performance comparison between small hand-written SVE kernels and compiler-generated ones.☆12Jun 17, 2022Updated 4 years ago
- A memory-centric profiling tool suite for heterogeneous memory☆10Nov 13, 2024Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- CUDA MoE kernels.☆12Sep 21, 2024Updated 2 years ago
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆31Jan 22, 2026Updated 9 months ago
- 使用VC检测车道线（曲线）☆10Apr 23, 2018Updated 8 years ago
- Agent-friendly GPU profile-query CLI☆130Oct 4, 2026Updated 3 weeks ago
- Composable and Embeddable Communication Runtime for Distributed AI Services☆101Oct 7, 2026Updated 3 weeks ago
- Profiling Spark Applications for Performance Comparison and Diagnosis☆16Nov 11, 2018Updated 7 years ago
- ☆58Apr 22, 2026Updated 6 months ago
- Simple example that demonstrates partial mapping of OpenSHMEM over libfabric☆11Jun 16, 2015Updated 11 years ago
- ☆32Aug 24, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- FLA but cuTile☆27Apr 17, 2026Updated 6 months ago
- Humming is a high-performance, lightweight, and highly flexible JIT (Just-In-Time) compiled GEMM kernel library specifically designed for…☆340Updated this week
- This is the canonical git mirror of the LLVM subversion repository. The repository does not accept github pull requests at this moment. P…☆11Oct 23, 2019Updated 7 years ago
- FlashPrefill V2: Block-Sparse Prefill Attention for Long-Context LLM Serving☆32Aug 28, 2026Updated 2 months ago
- the Stanford Transactional Applications for Multi-Processing; a benchmark suite for transactional memory research☆44Oct 1, 2021Updated 5 years ago
- Lightweight performance and debugging tools☆17Feb 21, 2020Updated 6 years ago
- Inference Llama 2 in one file of pure Cuda☆17Aug 20, 2023Updated 3 years ago
- Fighting!☆11Jul 21, 2017Updated 9 years ago
- Framework for Openstack High Availability Testing☆21Sep 23, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Memory Sampling Tool using Linux perf_events☆15Aug 5, 2022Updated 4 years ago
- Official Implementation for DLite☆50Oct 21, 2026Updated last week
- Make FP4 on 5090 Great Again☆24Jul 20, 2026Updated 3 months ago
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 3 months ago
- ☆32Jul 2, 2025Updated last year
- ☆134Updated this week
- ☆267Oct 14, 2026Updated 2 weeks ago