dhcode-cpp / easy-dualpipeLinks
Pipeline-Parallel Lecture: Simplest Dualpipe Implementation.
☆31Updated 3 months ago
Alternatives and similar repositories for easy-dualpipe
Users that are interested in easy-dualpipe are comparing it to the libraries listed below
Sorting:
- ☆150Updated 6 months ago
- Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library☆49Updated 4 months ago
- qwen-nsa☆87Updated 2 months ago
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆144Updated 2 weeks ago
- ☆153Updated 10 months ago
- DeepSeek Native Sparse Attention pytorch implementation☆111Updated 3 weeks ago
- Efficient Mixture of Experts for LLM Paper List☆154Updated 3 months ago
- 青稞Talk☆184Updated this week
- ☆45Updated last year
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆61Updated last year
- Tiny-Megatron, a minimalistic re-implementation of the Megatron library☆21Updated 4 months ago
- Triton Documentation in Chinese Simplified / Triton 中文文档☆96Updated 3 weeks ago
- Implementation of FlashAttention in PyTorch☆179Updated last year
- Implement some method of LLM KV Cache Sparsity☆41Updated last year
- ☆84Updated 8 months ago
- ☆79Updated 2 years ago
- [NeurIPS 2024] The official implementation of "Kangaroo: Lossless Self-Speculative Decoding for Accelerating LLMs via Double Early Exitin…☆64Updated last year
- ☆109Updated this week
- [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training☆256Updated 5 months ago
- UltraScale Playbook 中文版☆109Updated 9 months ago
- The Official Implementation of Ada-KV [NeurIPS 2025]☆123Updated last month
- Bridge Megatron-Core to Hugging Face/Reinforcement Learning☆181Updated this week
- A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…☆96Updated 4 months ago
- A flexible and efficient training framework for large-scale alignment tasks☆447Updated 2 months ago
- LLM training technologies developed by kwai☆69Updated last week
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆138Updated last year
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆120Updated last year
- A MoE impl for PyTorch, [ATC'23] SmartMoE☆71Updated 2 years ago
- Implementation for FP8/INT8 Rollout for RL training without performence drop.☆281Updated 2 months ago
- simplest online-softmax notebook for explain Flash Attention☆13Updated last year