Alternatives and similar repositories for Megatron-Bridge

Users that are interested in Megatron-Bridge are comparing it to the libraries listed below

• ISEEKYAN / mbridge
  Bridge Megatron-Core to Hugging Face/Reinforcement Learning
  ☆185Updated this week
• yaof20 / Flash-RL
  Implementation for FP8/INT8 Rollout for RL training without performence drop.
  ☆287Updated 2 months ago
• RulinShao / LightSeq
  Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Training
  ☆221Updated last year
• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆264Updated last month
• zhuzilin / ring-flash-attention
  Ring attention implementation with flash attention
  ☆967Updated 4 months ago
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆280Updated 2 months ago
• NVIDIA / Megatron-Energon
  Megatron's multi-modal data loader
  ☆309Updated last week
• NVIDIA-NeMo / Automodel
  Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
  ☆250Updated last week
• yanring / Megatron-MoE-ModelZoo
  Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.
  ☆156Updated this week
• fla-org / flame
  🔥 A minimal training framework for scaling FLA models
  ☆335Updated 2 months ago
• feifeibear / long-context-attention
  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
  ☆631Updated last week
• Dao-AILab / sonic-moe
  Accelerating MoE with IO and Tile-aware Optimizations
  ☆553Updated last week
• openpsi-project / ReaLHF
  Super-Efficient RLHF Training of LLMs with Parameter Reallocation
  ☆330Updated 9 months ago
• fanshiqing / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆182Updated last month
• NVlabs / COAT
  [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training
  ☆257Updated 5 months ago
• mit-han-lab / Quest
  [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
  ☆368Updated 6 months ago
• XunhaoLai / native-sparse-attention-triton
  Efficient triton implementation of Native Sparse Attention.
  ☆261Updated 8 months ago
• mit-han-lab / duo-attention
  [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
  ☆521Updated 11 months ago
• FasterDecoding / SnapKV
  ☆300Updated 6 months ago
• microsoft / SeerAttention
  SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
  ☆187Updated 4 months ago
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆262Updated 3 months ago
• radixark / miles
  Miles is an enterprise-facing reinforcement learning framework for large-scale MoE post-training and production workloads, forked from an…
  ☆744Updated last week
• alexzhang13 / flashattention2-custom-mask
  Triton implementation of FlashAttention2 that adds Custom Masks.
  ☆163Updated last year
• ByteDance-Seed / FlexPrefill
  Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
  ☆161Updated 3 months ago
• sgl-project / SpecForge
  Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
  ☆639Updated this week
• agentica-project / verl-pipeline
  Async pipelined version of Verl
  ☆124Updated 9 months ago
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆140Updated 7 months ago
• hemingkx / Spec-Bench
  Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)
  ☆355Updated 9 months ago
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆448Updated 8 months ago
• Dao-AILab / grouped-latent-attention
  ☆133Updated 7 months ago