SGLang is a fast serving framework for large language models and vision language models.
☆14Oct 19, 2026Updated this week
Alternatives and similar repositories for sglang
Users that are interested in sglang are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A fork of jasl/vllm (codex/ds4-sm120-min-enable) with CPU-GPU hybrid inference support for DeepSeek-V4 on SM120+.☆31Sep 10, 2026Updated last month
- ucore+ repository for OS laboratory 2015☆11Jun 1, 2018Updated 8 years ago
- 一个Turing专用vLLM分支，通过整合FlashInfer 0.6.18（PR #3526）与SM75后端门槛补丁（PR #47949），持续同步vLLM主线最新版本☆34Oct 11, 2026Updated last week
- CPU-GPU hybrid inference for DeepSeek-V4 on NVIDIA SM80+ (A100/RTX 4090 etc.), forked from yhfgyyf/vllm-deepseek-v4-sm89.☆60Sep 16, 2026Updated last month
- Use tensor core to calculate back-to-back HGEMM (half-precision general matrix multiplication) with MMA PTX instruction.☆14Nov 3, 2023Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- The serverside backend created for use with the LoRA Easy Training Scripts Frontend☆18Sep 29, 2026Updated 3 weeks ago
- 加拿大的社会新闻生活信息☆11Mar 24, 2023Updated 3 years ago
- FlashInfer: Kernel Library for LLM Serving (Windows build & kernels)☆20Oct 13, 2026Updated last week
- ☆13Nov 25, 2019Updated 6 years ago
- ☆10Apr 24, 2023Updated 3 years ago
- High-performance Triton backend for NVIDIA Turing (SM75) GPUs.☆50Sep 27, 2026Updated 3 weeks ago
- Kafka consumer & producer for scalaz-stream☆12Dec 15, 2017Updated 8 years ago
- A simple Gradio WebUI for loading/unloading models and loras in tabbyAPI.☆20Nov 21, 2024Updated last year
- Yet another Polyhedra Compiler for DeepLearning☆19Apr 14, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- HITSZ 面向对象的软件构造实践课程项目（实现飞机大战的安卓版）☆17Nov 12, 2023Updated 2 years ago
- Ultra Small < 100 MB Arch Linux (as well as ArchAssault, BlackArch, BBQLinux and more) base container.☆15Oct 2, 2019Updated 7 years ago
- SWE-Serve: an agentic benchmark of 53 production inference-engineering tasks derived from merged SGLang pull requests, run with Harbor.☆19Oct 9, 2026Updated 2 weeks ago
- About a year ago, I deciphered some of Verizon's Carrier Bundle type-mask system for iPhones, and used it to produce a tethering hack- th…☆12Jan 24, 2025Updated last year
- 多引擎（FunASR / Qwen3）语音转录 + 说话人识别服务，WebSocket API，macOS / CUDA，支持音视频转写，分角色，自动合并相同人物的话。☆16Updated this week
- ☆28Aug 30, 2023Updated 3 years ago
- ☆16Apr 12, 2020Updated 6 years ago
- Transformer library for OpenConfig YANG JSON☆17Mar 18, 2023Updated 3 years ago
- ☆19Aug 19, 2021Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Hikari's curated English measured notes on local LLM systems (serving, specdec, training, steering).☆14Jul 29, 2026Updated 2 months ago
- blackarch wordlists☆10May 3, 2020Updated 6 years ago
- study of Ampere' Sparse Matmul☆18Jan 10, 2021Updated 5 years ago
- Turn your saved web into a local knowledge workspace for AI agents.☆16Apr 10, 2026Updated 6 months ago
- Horizon area chart D3 component☆10Oct 14, 2026Updated last week
- Flowin' with Wireshark: Hacks and Tips to Rule the Network☆10Sep 8, 2024Updated 2 years ago
- ☆10Apr 14, 2026Updated 6 months ago
- Sticky / post-it notes for Hermes Desktop (disk plugin)☆15Sep 19, 2026Updated last month
- Train Llama Loras Easily☆30Aug 3, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆11Nov 29, 2023Updated 2 years ago
- 华为集合通信性能测试☆16May 27, 2024Updated 2 years ago
- Strip AI writing tells at two layers: surface (Wikipedia Signs of AI writing) + narrative (StoryScope, arXiv:2604.03136). A model-agnosti…☆20Oct 1, 2026Updated 3 weeks ago
- A simple command line tool designed to explore the mechanics of dictionary attacks on the FTP protocol.☆20Jun 16, 2021Updated 5 years ago
- Linux kernel hooking library☆21May 23, 2020Updated 6 years ago
- An RISC-V experimental OS☆27Sep 19, 2023Updated 3 years ago
- Interactive patcher for the Claude Code native binary. Live inline thinking, detailed tool calls, subagent model overrides, custom brandi…☆21Oct 15, 2026Updated last week