Alternatives and similar repositories for easy-dualpipe

Users that are interested in easy-dualpipe are comparing it to the libraries listed below

• dhcode-cpp / online-softmax
  simplest online-softmax notebook for explain Flash Attention
  ☆13Updated 7 months ago
• mdy666 / mdy_triton
  ☆140Updated last month
• shreyansh26 / FlashAttention-PyTorch
  Implementation of FlashAttention in PyTorch
  ☆159Updated 6 months ago
• madsys-dev / deepseekv2-profile
  ☆145Updated 5 months ago
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆55Updated 9 months ago
• mdy666 / Qwen-Native-Sparse-Attention
  qwen-nsa
  ☆70Updated 3 months ago
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆78Updated 3 months ago
• alibaba / ChatLearn
  A flexible and efficient training framework for large-scale alignment tasks
  ☆400Updated this week
• AniZpZ / AutoSmoothQuant
  An easy-to-use package for implementing SmoothQuant for LLMs
  ☆103Updated 4 months ago
• liangyuwang / Tiny-DeepSpeed
  Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library
  ☆41Updated last week
• preacher-1 / MLA_tutorial
  from MHA, MQA, GQA to MLA by 苏剑林, with code
  ☆25Updated 5 months ago
• fanshiqing / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆134Updated 3 weeks ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆102Updated 3 months ago
• cauyxy / bilivideos
  ☆52Updated 2 years ago
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆66Updated 2 years ago
• firechecking / CleanTransformer
  an implementation of transformer, bert, gpt, and diffusion models for learning purposes
  ☆155Updated 9 months ago
• DeepLink-org / dlinfer
  ☆52Updated this week
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆101Updated 3 weeks ago
• sunkx109 / llama
  Inference code for LLaMA models
  ☆122Updated last year
• dhcode-cpp / NSA-pytorch
  DeepSeek Native Sparse Attention pytorch implementation
  ☆83Updated 5 months ago
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated 2 years ago
• akaihaoshuai / baby-llama2-chinese_cybertron
  使用单个24G显卡，从0开始训练LLM
  ☆56Updated last month
• kwai / Megatron-Kwai
  [USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Paral…
  ☆61Updated last year
• hengjiUSTC / learn-llm
  ☆112Updated 8 months ago
• Ascend / AscendSpeed
  ☆79Updated last year
• MoFHeka / LLaMA-Megatron
  A LLaMA1/LLaMA12 Megatron implement.
  ☆28Updated last year
• HarryWu99 / llm_kvcache_sparsity
  Implement some method of LLM KV Cache Sparsity
  ☆35Updated last year
• ISEEKYAN / verl_megatron_practice
  (best/better) practices of megatron on veRL and tuning guide
  ☆41Updated last week
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆58Updated 9 months ago
• CoinCheung / gdGPT
  Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
  ☆97Updated last year