Alternatives and similar repositories for Tiny-DeepSpeed

Users that are interested in Tiny-DeepSpeed are comparing it to the libraries listed below

• OpenSparseLLMs / Linear-MoE
  ☆113Updated 2 months ago
• mdy666 / Qwen-Native-Sparse-Attention
  qwen-nsa
  ☆70Updated 3 months ago
• SkyworkAI / skywork-o1-prm-inference
  ☆65Updated 8 months ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆102Updated 3 months ago
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆87Updated 7 months ago
• GAIR-NLP / MAYE
  Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme
  ☆138Updated 4 months ago
• NVlabs / Fast-dLLM
  Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"
  ☆331Updated last week
• dhcode-cpp / NSA-pytorch
  DeepSeek Native Sparse Attention pytorch implementation
  ☆83Updated 5 months ago
• step-law / steplaw
  ☆198Updated 3 months ago
• mdy666 / mdy_triton
  ☆140Updated last month
• microsoft / SeerAttention
  SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
  ☆141Updated last week
• Wangmerlyn / MCTS-GSM8k-Demo
  This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems
  ☆85Updated 4 months ago
• openpsi-project / ReaLHF
  Super-Efficient RLHF Training of LLMs with Parameter Reallocation
  ☆307Updated 3 months ago
• GAIR-NLP / LIMR
  ☆205Updated 5 months ago
• sii-research / siiRL
  siiRL: Shanghai Innovation Institute RL Framework for Advanced LLMs and Multi-Agent Systems
  ☆152Updated this week
• testtimescaling / testtimescaling.github.io
  "what, how, where, and how well? a survey on test-time scaling in large language models" repository
  ☆56Updated this week
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆49Updated 9 months ago
• hemingkx / TokenSkip
  TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆171Updated last month
• modelscope / Trinity-RFT
  Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…
  ☆204Updated this week
• InternLM / OREAL
  Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning
  ☆188Updated 4 months ago
• PRIME-RL / Entropy-Mechanism-of-RL
  The Entropy Mechanism of Reinforcement Learning for Large Language Model Reasoning.
  ☆282Updated 3 weeks ago
• NVlabs / COAT
  [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training
  ☆221Updated last month
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆183Updated last month
• ruipeterpan / specreason
  PoC for "SpecReason: Fast and Accurate Inference-Time Compute via Speculative Reasoning" [arXiv '25]
  ☆43Updated 3 weeks ago
• HArmonizedSS / HASS
  Official Implementation of "Learning Harmonized Representations for Speculative Sampling" (HASS)
  ☆43Updated 4 months ago
• sail-sg / LongSpec
  LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification
  ☆61Updated 3 weeks ago
• GAIR-NLP / ToRL
  ☆263Updated 2 months ago
• hemingkx / Spec-Bench
  Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)
  ☆303Updated 3 months ago
• sail-sg / oat-zero
  A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.
  ☆245Updated 3 months ago
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆234Updated 2 months ago