Cookbook of SGLang - Recipe
☆10May 5, 2026Updated 6 months ago
Alternatives and similar repositories for sgl-cookbook
Users that are interested in sgl-cookbook are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SGLang wheels for multiple platforms☆11Oct 13, 2025Updated last year
- ☆11May 21, 2026Updated 5 months ago
- ☆23Oct 14, 2026Updated last month
- Breakable CUDA graph capture for PyTorch - capture compatible regions as CUDA graphs while running incompatible operations eagerly betwee…☆30Oct 8, 2026Updated last month
- SGLang Kernel Wheel Index☆27Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆31Jan 22, 2026Updated 9 months ago
- ☆19May 16, 2026Updated 6 months ago
- a repo to study TensorRT Plugin☆11Apr 30, 2025Updated last year
- a size profiler for cuda binary☆74Oct 3, 2026Updated last month
- My attempt to improve the speed of the newton schulz algorithm, starting from the dion implementation.☆42Apr 30, 2026Updated 6 months ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆47Updated this week
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆527Updated this week
- Easy recipes to speed up latency of Flux, QwenImage, and LTX-2 with NVFP4 and MXFP8 on Blackwell.☆14Apr 10, 2026Updated 7 months ago
- The repository contains a reference end-to-end pipeline for a real-time video analytics application. Realtime data is provided to an infe…☆12Nov 3, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- DeeperGEMM: crazy optimized version☆85May 5, 2025Updated last year
- Official implementation of the paper "Length Value Model: Pretraining Value Model for Scalable Length Prediction and Control"☆13May 27, 2026Updated 5 months ago
- Lightweight Benchmark Server for Agentic GPU Programming☆59Updated this week
- Materials for learning SGLang☆906Jan 5, 2026Updated 10 months ago
- FlashTile is a CUDA Tile IR compiler that is compatible with NVIDIA's tileiras, targeting SM70 through SM121 NVIDIA GPUs.☆60Feb 6, 2026Updated 9 months ago
- Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆335Oct 14, 2026Updated last month
- Speed-of-Light SW efficiency by using ultra low-latency primitives for comms collectives☆13Apr 8, 2026Updated 7 months ago
- Ulysses sequence-parallel all-to-all as a torch custom op, moved by the GPU copy engines into torch symmetric memory. Zero SM usage; 1.66…☆56Aug 25, 2026Updated 2 months ago
- NCU-driven iterative optimization workflow for CUDA/CUTLASS/Triton/CuTe DSL kernels.☆25Apr 10, 2026Updated 7 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆25Nov 6, 2025Updated last year
- keys- 1M context: Inkling-Small-NVFP4 + DSpark + NVFP4 KV on SGLang, sm_121a-optimized on Two DGX Sparks — one-shot agent-executable rec…☆10Aug 17, 2026Updated 3 months ago
- Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…☆115Sep 11, 2025Updated last year
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 4 months ago
- Autonomous GPU kernel optimization system driven by AI agents.☆32Mar 29, 2026Updated 7 months ago
- ⚡️Qwen-Image 4.8x🎉 speedup with Hybrid Acceleration for low VRAM GPUs☆17Oct 24, 2025Updated last year
- ☆13Sep 9, 2026Updated 2 months ago
- NVFP4 Flash-Attention 4 on BlackWell☆69Sep 26, 2026Updated last month
- An experimental communicating attention kernel based on DeepEP.☆34Jul 29, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Block-GTQ: RoPE-aware bit allocation for KV-cache quantization☆17Oct 29, 2026Updated 3 weeks ago
- sherpa with mlx☆15Aug 2, 2025Updated last year
- 把 On-Policy Distillation 接到 DSpark。☆19Jun 28, 2026Updated 4 months ago
- 🔥LongCat-Video 1.7x🎉 speedup: cache acceleration and 4/8-bits weight only.☆16Oct 28, 2025Updated last year
- Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.☆3,331Updated this week
- Compact and Agent-Native MoE Training System☆360Updated this week
- SGLang kernel library for Intel XPU☆38Updated this week
Are these results useful?