☆118Jul 3, 2026Updated 3 months ago
Alternatives and similar repositories for SGLang-FluentLLM
Users that are interested in SGLang-FluentLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆32Jul 2, 2026Updated 3 months ago
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated last month
- DeepStack: Facilitating Co-Design Exploration of 3D DRAM-Stacked Accelerators for Distributed LLM Inference. Includes the MICRO 2026 AE a…☆65Oct 5, 2026Updated last week
- DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang☆52Nov 19, 2025Updated 11 months ago
- Some funny cute/cuteDSL code snippets☆35Mar 2, 2026Updated 7 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆116Aug 5, 2026Updated 2 months ago
- Communication patterns for AI, built on top of NCCL device and host APIs☆68Updated this week
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆135Jun 24, 2025Updated last year
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆31Jan 22, 2026Updated 8 months ago
- ☆389Jan 28, 2026Updated 8 months ago
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 10 months ago
- 🎓Automatically Update circult-eda-mlsys-tinyml Papers Daily using Github Actions (Update Every 8th hours)☆10Updated this week
- Our bot helps optimize and automate MEV strategies, making them accessible to everyone. It outpaces profitable transactions and ensures v…☆13Dec 30, 2025Updated 9 months ago
- TokenSpeed is a speed-of-light LLM inference engine.☆2,699Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- verl Zero-Mismatch Dense/MoE HuggingFace Rollout☆74Oct 2, 2026Updated 2 weeks ago
- StepFun's flagship model for agentic work☆61Updated this week
- [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆102May 14, 2026Updated 5 months ago
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- FlashKDA: high-performance Kimi Delta Attention kernels☆1,281Sep 1, 2026Updated last month
- Accepted to MLSys 2026☆97Apr 19, 2026Updated 5 months ago
- ☆37Aug 7, 2025Updated last year
- ☆54May 19, 2025Updated last year
- ☆1,363Jun 23, 2026Updated 3 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆46Oct 15, 2025Updated last year
- ☆40Dec 14, 2025Updated 10 months ago
- ☆567Jul 8, 2026Updated 3 months ago
- Distributed MoE in a Single Kernel [NeurIPS '25]☆316May 5, 2026Updated 5 months ago
- High-performance LLM operator library built on TileLang.☆195Updated this week
- Sample Codes using NVSHMEM on Multi-GPU☆30Jan 22, 2023Updated 3 years ago
- ☆48Nov 1, 2025Updated 11 months ago
- FlashTile is a CUDA Tile IR compiler that is compatible with NVIDIA's tileiras, targeting SM70 through SM121 NVIDIA GPUs.☆61Feb 6, 2026Updated 8 months ago
- ☆127Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A collection of specialized agent skills for AI infrastructure development, enabling Claude Code to write, optimize, and debug high-perfo…☆150Jul 9, 2026Updated 3 months ago
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆207Feb 11, 2026Updated 8 months ago
- ☆98Feb 5, 2026Updated 8 months ago
- ☆32Jul 2, 2025Updated last year
- A lightweight design for computation-communication overlap.☆249Jan 20, 2026Updated 8 months ago
- Mixture-of-experts (MoE) training megakernel for NVL72s☆621Oct 1, 2026Updated 2 weeks ago
- A Overview of Efficiently Serving Foundation Models across Edge Devices☆15Jan 17, 2025Updated last year