gogongxt / nano-sglangView external linksLinks
☆120Updated this week
Alternatives and similar repositories for nano-sglang
Users that are interested in nano-sglang are comparing it to the libraries listed below
Sorting:
- LLM Inference via Triton (Flexible & Modular): Focused on Kernel Optimization using CUBIN binaries, Starting from gpt-oss Model☆64Oct 18, 2025Updated 3 months ago
- Cute layout visualization☆30Jan 18, 2026Updated 3 weeks ago
- A simple calculation for LLM MFU.☆67Sep 10, 2025Updated 5 months ago
- A Triton-only attention backend for vLLM☆23Updated this week
- A light llama-like llm inference framework based on the triton kernel.☆171Jan 5, 2026Updated last month
- DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang☆43Nov 19, 2025Updated 2 months ago
- ☆27Jan 7, 2025Updated last year
- Getting Started with Triton: A Tutorial for Python Beginners☆35Oct 21, 2025Updated 3 months ago
- 算子库☆17Jul 9, 2025Updated 7 months ago
- 基于昇腾310芯片的大语言模型部署☆24Jun 14, 2024Updated last year
- ☆155Mar 4, 2025Updated 11 months ago
- Benchmark code for the "Online normalizer calculation for softmax" paper☆105Jul 27, 2018Updated 7 years ago
- Canvas: End-to-End Kernel Architecture Search in Neural Networks☆27Nov 18, 2024Updated last year
- ☆21Apr 17, 2025Updated 9 months ago
- Scaling services with sm(Shard Manager), easy to build sharded application.☆24Oct 20, 2022Updated 3 years ago
- TACOS: [T]opology-[A]ware [Co]llective Algorithm [S]ynthesizer for Distributed Machine Learning☆31Jun 13, 2025Updated 8 months ago
- resizable hashing strategy for large-scale storage☆26Oct 6, 2019Updated 6 years ago
- ☆12Mar 21, 2024Updated last year
- An experimental communicating attention kernel based on DeepEP.☆35Jul 29, 2025Updated 6 months ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆114Sep 10, 2024Updated last year
- Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).☆25Jul 15, 2025Updated 7 months ago
- ☆34Feb 3, 2025Updated last year
- ☆25Aug 27, 2021Updated 4 years ago
- LMCache on Ascend☆49Updated this week
- [Archived] For the latest updates and community contribution, please visit: https://github.com/Ascend/TransferQueue or https://gitcode.co…☆13Jan 16, 2026Updated last month
- ☆54May 5, 2025Updated 9 months ago
- 🤖FFPA: Extend FlashAttention-2 with Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA EA.☆251Updated this week
- Luthier, a GPU binary instrumentation tool for AMD GPUs☆26Updated this week
- a size profiler for cuda binary☆72Jan 15, 2026Updated last month
- my solution for UC Berkeley AI projects pacman☆11Jul 25, 2020Updated 5 years ago
- ☆141Apr 23, 2024Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆39Aug 30, 2025Updated 5 months ago
- Framework to reduce autotune overhead to zero for well known deployments.☆96Sep 19, 2025Updated 4 months ago
- ☆152Jan 9, 2025Updated last year
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆51Jul 4, 2025Updated 7 months ago
- This project is based on the [LTX-Video](https://github.com/Lightricks/LTX-Video) algorithm of the diffusers and optimized and accelerate…☆12Dec 31, 2024Updated last year
- A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training☆639Updated this week
- ☆12Jan 21, 2026Updated 3 weeks ago
- 本项目是基于Unity编写的打鸭子游戏，包含打鸭子核心玩法实现，资源管理，移动端摇杆控制模块等元素。☆11Apr 13, 2022Updated 3 years ago