dhcode-cpp / easy-dualpipeLinks
Pipeline-Parallel Lecture: Simplest Dualpipe Implementation.
☆27Updated this week
Alternatives and similar repositories for easy-dualpipe
Users that are interested in easy-dualpipe are comparing it to the libraries listed below
Sorting:
- ☆143Updated 2 months ago
- Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library☆45Updated last month
- simplest online-softmax notebook for explain Flash Attention☆13Updated 8 months ago
- 青稞Talk☆145Updated last week
- DeepSeek Native Sparse Attention pytorch implementation☆95Updated last month
- qwen-nsa☆74Updated 5 months ago
- ☆147Updated 6 months ago
- Implementation of FlashAttention in PyTorch☆168Updated 8 months ago
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆111Updated 5 months ago
- UltraScale Playbook 中文版☆74Updated 6 months ago
- A flexible and efficient training framework for large-scale alignment tasks☆425Updated this week
- Inference code for LLaMA models☆123Updated 2 years ago
- Triton Documentation in Chinese Simplified / Triton 中文文档☆82Updated 5 months ago
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆56Updated 10 months ago
- Efficient Mixture of Experts for LLM Paper List☆127Updated this week
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆158Updated 11 months ago
- FlagScale is a large model toolkit based on open-sourced projects.☆353Updated last week
- ☆53Updated 2 years ago
- ☆114Updated 10 months ago
- Implement some method of LLM KV Cache Sparsity☆38Updated last year
- 注释的nano_vllm仓库,并且完成了MiniCPM4的适配以及注册新模型的功能☆69Updated last month
- 使用单个24G显卡,从0开始训练LLM☆55Updated 2 months ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆264Updated last month
- ☆60Updated last week
- TransMLA: Multi-Head Latent Attention Is All You Need☆356Updated 3 weeks ago
- (best/better) practices of megatron on veRL and tuning guide☆86Updated 2 weeks ago
- RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.☆72Updated 7 months ago
- ☆42Updated last year
- a-m-team's exploration in large language modeling☆188Updated 3 months ago
- Bridge Megatron-Core to Hugging Face/Reinforcement Learning☆126Updated this week