SGLang is a fast serving framework for large language models and vision language models.
☆34Sep 19, 2026Updated this week
Alternatives and similar repositories for sglang
Users that are interested in sglang are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆14Updated this week
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆13Nov 23, 2024Updated last year
- ☆284Sep 5, 2026Updated 2 weeks ago
- Debug print operator for cudagraph debugging☆18Aug 2, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Humming is a high-performance, lightweight, and highly flexible JIT (Just-In-Time) compiled GEMM kernel library specifically designed for…☆233Updated this week
- Handwritten GEMM using Intel AMX (Advanced Matrix Extension)☆17Jan 11, 2025Updated last year
- VNEC: A Vectorized Non-Empty Column Format for SpMV on cross-platform multicore CPUs☆10Feb 6, 2024Updated 2 years ago
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆31Jan 22, 2026Updated 7 months ago
- Make FP4 on 5090 Great Again☆24Jul 20, 2026Updated 2 months ago
- Code for the paper: Dense Reward for Free in Reinforcement Learning from Human Feedback (ICML 2024) by Alex J. Chan, Hao Sun, Samuel Holt…☆38Aug 11, 2024Updated 2 years ago
- Composable and Embeddable Communication Runtime for Distributed AI Services☆101Jun 5, 2026Updated 3 months ago
- Profiling Spark Applications for Performance Comparison and Diagnosis☆16Nov 11, 2018Updated 7 years ago
- FLA but cuTile☆27Apr 17, 2026Updated 5 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆457Aug 26, 2026Updated 3 weeks ago
- the Stanford Transactional Applications for Multi-Processing; a benchmark suite for transactional memory research☆44Oct 1, 2021Updated 4 years ago
- This is the canonical git mirror of the LLVM subversion repository. The repository does not accept github pull requests at this moment. P…☆11Oct 23, 2019Updated 6 years ago
- Inference Llama 2 in one file of pure Cuda☆17Aug 20, 2023Updated 3 years ago
- ☆232Aug 26, 2026Updated 3 weeks ago
- Public repo for kernel writing skills in CuTeDSL, Triton, Tilelang and CUDA☆25Jul 7, 2026Updated 2 months ago
- Memory Sampling Tool using Linux perf_events☆15Aug 5, 2022Updated 4 years ago
- Lightweight performance and debugging tools☆17Feb 21, 2020Updated 6 years ago
- A C++ discrete event simulation framework☆15Mar 24, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆32Jul 2, 2025Updated last year
- A direct convolution library targeting ARM multi-core CPUs.☆12Nov 27, 2024Updated last year
- ☆21Jul 22, 2022Updated 4 years ago
- ☆13Mar 29, 2019Updated 7 years ago
- This repo hosts the famfs kernel patch sets as branches☆11Mar 24, 2026Updated 5 months ago
- High-performance GPU kernels for Ads and Recsys model training, independently implemented and optimized for real-world workloads and mode…☆48Updated this week
- Automated High-Performance GPU Kernel Generation☆136Jun 1, 2026Updated 3 months ago
- The Splash-4 benchmark suite☆15Oct 26, 2023Updated 2 years ago
- A kernel module to enable RDMA transfers to/from IO, PFN and DAX mapped memory☆10Jun 23, 2015Updated 11 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆94Jul 14, 2026Updated 2 months ago
- high-performance linear attention kernel library built on TileLang☆704Updated this week
- Accelerating Multitask Training Trough Adaptive Transition [Efficient ML Model]☆12May 23, 2025Updated last year
- ☆49Apr 15, 2024Updated 2 years ago
- ☆12Oct 16, 2021Updated 4 years ago
- A set of common libraries for writing KubeVela ecosystem controllers.☆12Aug 26, 2026Updated 3 weeks ago
- Linux tree for ntrdma driver development.☆11Jun 29, 2017Updated 9 years ago