Alternatives and similar repositories for Tiny-DeepSpeed

Users that are interested in Tiny-DeepSpeed are comparing it to the libraries listed below

• modelscope / Trinity-RFT
  Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…
  ☆140Updated this week
• THUDM / slime
  slime is a LLM post-training framework aiming for RL Scaling.
  ☆596Updated this week
• SkyworkAI / skywork-o1-prm-inference
  ☆64Updated 7 months ago
• ruipeterpan / specreason
  PoC for "SpecReason: Fast and Accurate Inference-Time Compute via Speculative Reasoning" [arXiv '25]
  ☆41Updated this week
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆93Updated 3 months ago
• NVlabs / Fast-dLLM
  Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"
  ☆296Updated last week
• OpenSparseLLMs / Linear-MoE
  ☆110Updated last month
• step-law / steplaw
  ☆194Updated 3 months ago
• openpsi-project / ReaLHF
  Super-Efficient RLHF Training of LLMs with Parameter Reallocation
  ☆306Updated 2 months ago
• GAIR-NLP / LIMR
  ☆205Updated 4 months ago
• dhcode-cpp / NSA-pytorch
  DeepSeek Native Sparse Attention pytorch implementation
  ☆73Updated 4 months ago
• ganler / code-r1
  Reproducing R1 for Code with Reliable Rewards
  ☆237Updated 2 months ago
• GAIR-NLP / ToRL
  ☆241Updated last month
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆228Updated 2 months ago
• alibaba / ChatLearn
  A flexible and efficient training framework for large-scale alignment tasks
  ☆388Updated last week
• hemingkx / Spec-Bench
  Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)
  ☆285Updated 2 months ago
• LCLM-Horizon / A-Comprehensive-Survey-For-Long-Context-Language-Modeling
  A Comprehensive Survey on Long Context Language Modeling
  ☆163Updated last week
• MingyuJ666 / Rope_with_LLM
  [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…
  ☆74Updated 3 weeks ago
• InternLM / OREAL
  Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning
  ☆187Updated 3 months ago
• ElliottYan / LUFFY
  Official Repository of "Learning to Reason under Off-Policy Guidance"
  ☆251Updated last month
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆82Updated 7 months ago
• mdy666 / mdy_triton
  ☆140Updated 2 weeks ago
• thunlp / FR-Spec
  [ACL 2025 main] FR-Spec: Frequency-Ranked Speculative Sampling
  ☆36Updated this week
• Wangmerlyn / MCTS-GSM8k-Demo
  This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems
  ☆85Updated 3 months ago
• hemingkx / TokenSkip
  TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆166Updated 2 weeks ago
• mdy666 / Qwen-Native-Sparse-Attention
  qwen-nsa
  ☆68Updated 3 months ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆77Updated 5 months ago
• Zanette-Labs / efficient-reasoning
  ☆65Updated 3 months ago
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆179Updated 3 weeks ago
• CMU-AIRe / MRT
  Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".
  ☆99Updated this week