SGLang is a fast serving framework for large language models and vision language models.
☆34Nov 19, 2026Updated this week
Alternatives and similar repositories for sglang
Users that are interested in sglang are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆14Updated this week
- Curated high-performance TIRx GPU kernels☆38Updated this week
- CUDA Graph runtime tensor debugging utilities for PyTorch☆18Jul 12, 2026Updated 4 months ago
- ☆125Nov 6, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆13Nov 23, 2024Updated last year
- ☆313Sep 5, 2026Updated 2 months ago
- Debug print operator for cudagraph debugging☆18Aug 2, 2024Updated 2 years ago
- Handwritten GEMM using Intel AMX (Advanced Matrix Extension)☆17Jan 11, 2025Updated last year
- Performance comparison between small hand-written SVE kernels and compiler-generated ones.☆11Jun 17, 2022Updated 4 years ago
- VNEC: A Vectorized Non-Empty Column Format for SpMV on cross-platform multicore CPUs☆10Feb 6, 2024Updated 2 years ago
- CUDA MoE kernels.☆13Sep 21, 2024Updated 2 years ago
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆31Jan 22, 2026Updated 9 months ago
- Modular Markdown-based audio skills for AI agents and developers, covering signal processing, synthesis, effects, analysis, and spatial a…☆25May 21, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Code and reproducibility artifacts for reconstructing megakernel persistence with CUDA PDL☆28Aug 5, 2026Updated 3 months ago
- 使用VC检测车道线(曲线)☆10Apr 23, 2018Updated 8 years ago
- Composable and Embeddable Communication Runtime for Distributed AI Services☆103Oct 7, 2026Updated last month
- Agent-friendly GPU profile-query CLI☆131Oct 4, 2026Updated last month
- Simple example that demonstrates partial mapping of OpenSHMEM over libfabric☆11Jun 16, 2015Updated 11 years ago
- FLA but cuTile☆27Apr 17, 2026Updated 7 months ago
- Code for the paper: Dense Reward for Free in Reinforcement Learning from Human Feedback (ICML 2024) by Alex J. Chan, Hao Sun, Samuel Holt…☆38Aug 11, 2024Updated 2 years ago
- Profiling Spark Applications for Performance Comparison and Diagnosis☆16Nov 11, 2018Updated 8 years ago
- Inference Llama 2 in one file of pure Cuda☆17Aug 20, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Fused MoE kernel☆24Oct 30, 2026Updated 2 weeks ago
- This is the canonical git mirror of the LLVM subversion repository. The repository does not accept github pull requests at this moment. P…☆11Oct 23, 2019Updated 7 years ago
- the Stanford Transactional Applications for Multi-Processing; a benchmark suite for transactional memory research☆44Oct 1, 2021Updated 5 years ago
- Lightweight performance and debugging tools☆17Feb 21, 2020Updated 6 years ago
- Dist-MoE implements Speed-of-Light distributed Mixture-of-Experts forward and backward kernels. They are highly optimized and fused comm-…☆79Updated this week
- A tiny compiler which translates SysY(a subset of C language) into ARM-v7a assembly.☆15Sep 4, 2021Updated 5 years ago
- 🧩 Claude Code Neovim IDE Extension☆11Apr 30, 2026Updated 6 months ago
- ☆32Jul 2, 2025Updated last year
- Flash-GMM, a memory-efficient GPU kernel that unlocks GMM soft clustering at billion-scale☆25Sep 30, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Memory Sampling Tool using Linux perf_events☆15Aug 5, 2022Updated 4 years ago
- A direct convolution library targeting ARM multi-core CPUs.☆12Nov 27, 2024Updated last year
- ☆13Mar 29, 2019Updated 7 years ago
- Humming is a high-performance, lightweight, and highly flexible JIT (Just-In-Time) compiled GEMM kernel library specifically designed for…☆369Updated this week
- Read the book “Fluid Engine Development”, and expand it if possible。☆10Dec 2, 2023Updated 2 years ago
- A kernel module to enable RDMA transfers to/from IO, PFN and DAX mapped memory☆10Jun 23, 2015Updated 11 years ago
- This repo hosts the famfs kernel patch sets as branches☆11Mar 24, 2026Updated 7 months ago
Are these results useful?