☆54Aug 6, 2024Updated 2 years ago
Alternatives and similar repositories for Awesome-LLM-Training-System
Users that are interested in Awesome-LLM-Training-System are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Nov 21, 2025Updated 11 months ago
- ☆11Oct 29, 2026Updated last week
- A lightweight CuTe-based CUDA kernel for DuoAttention, optimized for large language model inference.☆12Dec 25, 2025Updated 10 months ago
- Mini-SGLang is a mini version of SGLang project ().☆13Sep 24, 2025Updated last year
- Reliable Sandbox for Agent, with agent-aware Checkpoint and Restore ability.☆15Aug 31, 2026Updated 2 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆19May 9, 2025Updated last year
- Autonomous CUDA kernel optimization agent with structured task specs and per-config scoring☆19Jun 17, 2026Updated 4 months ago
- Paper reading and discussion notes, covering AI frameworks, distributed systems, cluster management, etc.☆77Mar 4, 2026Updated 8 months ago
- ☆54May 19, 2025Updated last year
- Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library☆53Aug 20, 2025Updated last year
- W4A16 MoE GEMM CUDA kernel. Tuned for H200, B200 & B300.☆14Oct 30, 2026Updated last week
- Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.☆73Mar 20, 2025Updated last year
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 11 months ago
- Distributed SDDMM Kernel☆13Jul 8, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A visualization tool to display TF-Grappler optimized op graph☆13Aug 31, 2022Updated 4 years ago
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆34Nov 29, 2024Updated last year
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆13Nov 23, 2024Updated last year
- ☆648Jan 14, 2026Updated 9 months ago
- Resource Multiplexing in Tuning and Serving Large Language Models (USENIX ATC 2025)☆10Apr 21, 2026Updated 6 months ago
- A Triton-only attention backend for vLLM☆28Jul 14, 2026Updated 3 months ago
- Website for CSE 234, Winter 2025☆16Mar 24, 2025Updated last year
- LoRAFusion: Efficient LoRA Fine-Tuning for LLMs☆30Jul 2, 2026Updated 4 months ago
- ☆19Jul 5, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Stateful LLM Serving☆110Mar 11, 2025Updated last year
- ☆17Jan 31, 2026Updated 9 months ago
- Minimal PyTorch implementation of TP, SP, FSDP and sharded-EMA☆32Nov 27, 2025Updated 11 months ago
- BlitzScale Router - Distributed LLM Inference Router (Rust)☆17May 25, 2026Updated 5 months ago
- ☆28Oct 1, 2025Updated last year
- ☆17Updated this week
- ☆10Sep 12, 2024Updated 2 years ago
- CUDA Graph runtime tensor debugging utilities for PyTorch☆18Jul 12, 2026Updated 3 months ago
- Code for ECCV2022 Paper "Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI Detection"☆37Feb 20, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆13Mar 26, 2024Updated 2 years ago
- [MLSys 26] 🥇 Solution for Gated Delta Net Track of MLSys 26 Flash infer competition☆38May 22, 2026Updated 5 months ago
- ☆14Dec 10, 2024Updated last year
- The repository for ATC'25 paper "Greyhound: Hunting Fail-Slows in Hybrid-Parallel Training at Scale"☆18Sep 7, 2026Updated 2 months ago
- Implementation from scratch in C of the Multi-head latent attention used in the Deepseek-v3 technical paper.☆18Jan 15, 2025Updated last year
- NCCL communication API layer, and transport layer created from first principles.☆16Aug 20, 2025Updated last year
- ☆34Jan 24, 2026Updated 9 months ago
Are these results useful?