The official implementation of the paper "A Dual-Space Framework for General Knowledge Distillation of Large Language Models".
☆17Jan 4, 2026Updated 9 months ago
Alternatives and similar repositories for DSKDv2
Users that are interested in DSKDv2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both same…☆65Mar 21, 2026Updated 7 months ago
- Code for "Think Natively: Unlocking Multilingual Reasoning with Consistency-Enhanced Reinforcement Learning".☆28Nov 11, 2025Updated 11 months ago
- [ICLR 2026] CoT-Evo: Evolutionary Distillation of Chain-of-Thought for Scientific Reasoning☆14Feb 12, 2026Updated 8 months ago
- ☆28Aug 31, 2025Updated last year
- "R1-Ranker: Teaching LLM Rankers to Reason", Tao Feng, Zhigang Hua, Zijie Lei, Yan Xie, Shuang Yang, Bo Long, Jiaxuan You☆14Feb 5, 2026Updated 8 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆15Oct 22, 2024Updated 2 years ago
- Code for "On Expressive Power of Looped Transformers: Theoretical Analysis and Enhancement via Timestep Encoding (ICML 2025)"☆10Jun 29, 2025Updated last year
- A Teacher–Student Cooperation Framework to Synthesize Student-Consistent SFT Data☆38May 1, 2026Updated 5 months ago
- Code for the paper Depth Memory☆14Oct 14, 2026Updated 2 weeks ago
- ⚡ Official code for “Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus”…☆25Aug 13, 2026Updated 2 months ago
- A user-friendly & efficient knowledge distillation framework for LLMs, supporting off-policy, full vocab on-policy (OPD), cross-tokenizer…☆254Oct 21, 2026Updated last week
- Official Code for "Token Distillation: Attention-aware Input Embeddings for New Tokens"☆13Mar 11, 2026Updated 7 months ago
- Code for "Gated Recurrent Transformers: Expressive Depth through Recurrent Modulation"☆19Sep 1, 2026Updated last month
- Chain-of-Thought Matters: Improving Long-Context Language Models with Reasoning Path Supervision☆18Apr 1, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- [ICML 2026] Hybrid Policy Distillation (HPD) is a practical distillation framework for reasoning-oriented language models. This repositor…☆24Apr 24, 2026Updated 6 months ago
- This is the official code for OThink-R1 project.☆21Jun 19, 2025Updated last year
- ☆54Feb 12, 2025Updated last year
- ☆17Jun 10, 2025Updated last year
- (Nanochat based) Full-bandwidth transformer, feed LLM's own deep hidden states back to itself☆16Oct 3, 2026Updated 3 weeks ago
- Pipelined Self-Speculative Decoding for Looped Transformer☆21Sep 24, 2026Updated last month
- ☆13Jul 2, 2025Updated last year
- CHERRL: A Controllable Hacking Environment for Rubric-Based Reinforcement Learning☆16Oct 15, 2026Updated 2 weeks ago
- LRT☆20Sep 19, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆29Sep 7, 2026Updated last month
- ☆16Jul 21, 2025Updated last year
- TReB is a reliable and comprehensive benchmark that offers assessment of LLM capabilities for table reasoning☆13Jul 30, 2026Updated 3 months ago
- An opinionated NLP research template☆10Aug 29, 2024Updated 2 years ago
- The official implementation of MaskGRPO: Consolidating Reinforcement Learning for Multimodal Discrete Diffusion Models. (ICLR 2026, arxiv…☆19Jan 27, 2026Updated 9 months ago
- Python source code for EMNLP 2021 Findings paper: "Subword Mapping and Anchoring Across Languages".☆13Sep 17, 2021Updated 5 years ago
- The code of ACL2022 paper "Conditional Bilingual Mutual Information based Adaptive Training for Neural Machine Translation"..☆14Aug 6, 2022Updated 4 years ago
- Awesome papers, benchmarks, and research resources for jev and related research.☆17Oct 18, 2026Updated last week
- ☆26Aug 3, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆11Mar 10, 2025Updated last year
- FlashLoop: Fast and Memory-Efficient Looped Transformers via Lazy Updates☆22Sep 28, 2026Updated last month
- Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs☆14Apr 3, 2025Updated last year
- [ICLR'25] MA-RLHF: Reinforcement Learning from Human Feedback with Macro Actions☆13Jun 6, 2025Updated last year
- ☆12Mar 15, 2024Updated 2 years ago
- ☆22Dec 11, 2024Updated last year
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆99Nov 17, 2024Updated last year