hemingkx / TokenSkip
TokenSkip: Controllable Chain-of-Thought Compression in LLMs
☆120Updated last month
Alternatives and similar repositories for TokenSkip:
Users that are interested in TokenSkip are comparing it to the libraries listed below
- Model merging is a highly efficient approach for long-to-short reasoning.☆38Updated 2 weeks ago
- This repository contains a regularly updated paper list for LLMs-reasoning-in-latent-space.☆69Updated last week
- [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration☆45Updated last month
- ☆50Updated this week
- Chain of Thoughts (CoT) is so hot! so long! We need short reasoning process!☆48Updated 2 weeks ago
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆62Updated 2 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆174Updated last month
- Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".☆52Updated 4 months ago
- ☆132Updated 8 months ago
- [ICLR 2025] SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction☆66Updated 3 weeks ago
- Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both same…☆46Updated 5 months ago
- ☆89Updated 3 weeks ago
- The official code repository for PRMBench.☆69Updated 2 months ago
- An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT☆89Updated last month
- Awesome-Long2short-on-LRMs is a collection of state-of-the-art, novel, exciting long2short methods on large reasoning models. It contains…☆185Updated this week
- We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.☆61Updated 5 months ago
- [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.☆112Updated 3 weeks ago
- ☆74Updated 3 weeks ago
- Language Imbalance Driven Rewarding for Multilingual Self-improving☆16Updated 5 months ago
- [NeurIPS'24] Official code for *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*☆101Updated 4 months ago
- ☆65Updated last year
- 🚀 LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training☆80Updated 4 months ago
- [ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"☆79Updated 10 months ago
- Official repository for paper: O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning☆66Updated last month
- ☆39Updated 4 months ago
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆180Updated 3 weeks ago
- [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".☆74Updated 3 months ago
- [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy☆60Updated 4 months ago
- ☆91Updated last month
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆107Updated last year