Alternatives and similar repositories for TinyDeepSeek

Users that are interested in TinyDeepSeek are comparing it to the libraries listed below

• OpenSparseLLMs / Linear-MoE
  ☆95Updated 2 weeks ago
• hemingkx / TokenSkip
  TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆147Updated 2 months ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆69Updated 3 months ago
• LINs-lab / DynMoE
  [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
  ☆97Updated 3 months ago
• OpenSparseLLMs / MoM
  ☆83Updated last month
• SkyworkAI / skywork-o1-prm-inference
  ☆63Updated 6 months ago
• MingyuJ666 / Rope_with_LLM
  [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…
  ☆69Updated last week
• RyanLiu112 / GenPRM
  Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆73Updated this week
• mdy666 / Qwen-Native-Sparse-Attention
  qwen-nsa
  ☆66Updated last month
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆45Updated 7 months ago
• fscdc / Awesome-Efficient-Reasoning-Models
  [arXiv 2025] Efficient Reasoning Models: A Survey
  ☆166Updated last week
• Jikai0Wang / OPT-Tree
  ☆23Updated last week
• abdelfattah-lab / SplitReason
  ☆16Updated 3 weeks ago
• CJReinforce / PURE
  Official code for the paper, "Stop Summation: Min-Form Credit Assignment Is All Process Reward Model Needs for Reasoning"
  ☆123Updated this week
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆63Updated last week
• RUCAIBox / EASYEP
  ☆18Updated last month
• sramshetty / ShortGPT
  Unofficial implementations of block/layer-wise pruning methods for LLMs.
  ☆69Updated last year
• liangyuwang / zo2
  ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory
  ☆95Updated last month
• GAIR-NLP / ToRL
  ☆210Updated last week
• GAIR-NLP / MAYE
  Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme
  ☆129Updated last month
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆105Updated 2 months ago
• ElliottYan / LUFFY
  Official Repository of "Learning to Reason under Off-Policy Guidance"
  ☆212Updated this week
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆120Updated 7 months ago
• EIT-NLP / Awesome-Latent-CoT
  This repository contains a regularly updated paper list for LLMs-reasoning-in-latent-space.
  ☆107Updated this week
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆215Updated 3 weeks ago
• Joshua-Ren / Learning_dynamics_LLM
  ☆131Updated 3 weeks ago
• TIGER-AI-Lab / verl-tool
  A version of verl to support tool use
  ☆172Updated this week
• sanowl / OmegaPRM
  this is an implementation for the paper Improve Mathematical Reasoning in Language Models by Automated Process Supervision from google de…
  ☆32Updated 2 months ago
• YangLing0818 / SuperCorrect-llm
  [ICLR 2025] SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  ☆70Updated 2 months ago
• hemingkx / SWIFT
  [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
  ☆49Updated 3 months ago