FreedomIntelligence / TinyDeepSeekLinks
Reproduction of the complete process of DeepSeek-R1 on small-scale models, including Pre-training, SFT, and RL.
☆28Updated 8 months ago
Alternatives and similar repositories for TinyDeepSeek
Users that are interested in TinyDeepSeek are comparing it to the libraries listed below
Sorting:
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆87Updated 9 months ago
- [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models☆145Updated 4 months ago
- "what, how, where, and how well? a survey on test-time scaling in large language models" repository☆78Updated this week
- [EMNLP 2025] TokenSkip: Controllable Chain-of-Thought Compression in LLMs☆193Updated this week
- ☆120Updated 5 months ago
- ☆110Updated 2 months ago
- D^2-MoE: Delta Decompression for MoE-based LLMs Compression☆71Updated 8 months ago
- CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Models (NeurIPS 2025)☆167Updated last month
- Chain of Thoughts (CoT) is so hot! so long! We need short reasoning process!☆70Updated 8 months ago
- ☆65Updated last year
- [ICML 2025 Oral] Mixture of Lookup Experts☆55Updated 6 months ago
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆140Updated 3 weeks ago
- Unveiling Super Experts in Mixture-of-Experts Large Language Models☆32Updated 2 months ago
- Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"☆66Updated last year
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆222Updated 4 months ago
- Efficient Mixture of Experts for LLM Paper List☆144Updated 2 months ago
- 🚀 LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training☆89Updated last year
- Official code for the paper, "Stop Summation: Min-Form Credit Assignment Is All Process Reward Model Needs for Reasoning"☆142Updated last month
- this is an implementation for the paper Improve Mathematical Reasoning in Language Models by Automated Process Supervision from google de…☆44Updated 4 months ago
- [TMLR 2025] Efficient Reasoning Models: A Survey☆280Updated last month
- Extrapolating RLVR to General Domains without Verifiers☆180Updated 3 months ago
- Official Repository of "Learning to Reason under Off-Policy Guidance"☆380Updated 2 months ago
- Official repository for paper: O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning☆98Updated 9 months ago
- [AAAI 2026] Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".☆90Updated 3 weeks ago
- ☆213Updated 9 months ago
- ☆169Updated last month
- ☆112Updated 5 months ago
- [NeurIPS 2024] A Novel Rank-Based Metric for Evaluating Large Language Models☆55Updated 6 months ago
- One-shot Entropy Minimization☆187Updated 5 months ago
- ☆29Updated 6 months ago