The official implementation of the paper "A Dual-Space Framework for General Knowledge Distillation of Large Language Models".
☆17Jan 4, 2026Updated 10 months ago
Alternatives and similar repositories for DSKDv2
Users that are interested in DSKDv2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both same…☆66Mar 21, 2026Updated 7 months ago
- Code for "Think Natively: Unlocking Multilingual Reasoning with Consistency-Enhanced Reinforcement Learning".☆29Nov 11, 2025Updated last year
- ☆28Aug 31, 2025Updated last year
- [COLING 2025] Let's Focus on Neuron: Neuron-Level Supervised Fine-tuning for Large Language Model☆10Jan 17, 2025Updated last year
- [ICLR 2026] CoT-Evo: Evolutionary Distillation of Chain-of-Thought for Scientific Reasoning☆14Feb 12, 2026Updated 9 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- "R1-Ranker: Teaching LLM Rankers to Reason", Tao Feng, Zhigang Hua, Zijie Lei, Yan Xie, Shuang Yang, Bo Long, Jiaxuan You☆14Feb 5, 2026Updated 9 months ago
- ☆15Oct 22, 2024Updated 2 years ago
- [Target-SFT] A Unifying Lens on Supervised Fine-Tuning Through Target Distribution Design☆13Jun 10, 2026Updated 5 months ago
- Code for "On Expressive Power of Looped Transformers: Theoretical Analysis and Enhancement via Timestep Encoding (ICML 2025)"☆10Jun 29, 2025Updated last year
- A Teacher–Student Cooperation Framework to Synthesize Student-Consistent SFT Data☆39May 1, 2026Updated 6 months ago
- Chain-of-Thought Matters: Improving Long-Context Language Models with Reasoning Path Supervision☆18Apr 1, 2025Updated last year
- Official implementation for "Knowledge Distillation with Refined Logits".☆24Aug 26, 2024Updated 2 years ago
- This is the official code for OThink-R1 project.☆21Jun 19, 2025Updated last year
- A user-friendly & efficient knowledge distillation framework for LLMs, supporting off-policy, full vocab on-policy (OPD), cross-tokenizer…☆257Updated this week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆17Jun 10, 2025Updated last year
- CycleFormer: TSP Solver Based on Language Modeling☆11Jul 12, 2024Updated 2 years ago
- Depth-Attention: Cross-Layer Value Mixing for Language Models☆12Aug 7, 2026Updated 3 months ago
- ☆54Feb 12, 2025Updated last year
- Code for the paper Depth Memory☆17Oct 14, 2026Updated last month
- [EMNLP 2025] KRETA: A Benchmark for Korean Reading and Reasoning in Text-Rich VQA Attuned to Diverse Visual Contexts☆11Sep 5, 2025Updated last year
- An opinionated NLP research template☆10Aug 29, 2024Updated 2 years ago
- ☆13Jul 2, 2025Updated last year
- The official implementation of MaskGRPO: Consolidating Reinforcement Learning for Multimodal Discrete Diffusion Models. (ICLR 2026, arxiv…☆19Jan 27, 2026Updated 9 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Official Code for "Token Distillation: Attention-aware Input Embeddings for New Tokens"☆13Mar 11, 2026Updated 8 months ago
- Generate realistic and diverse user personas for LLM agent benchmarks.☆13Oct 18, 2026Updated last month
- ☆16Jul 21, 2025Updated last year
- Code for "Gated Recurrent Transformers: Expressive Depth through Recurrent Modulation"☆19Sep 1, 2026Updated 2 months ago
- ☆11Mar 10, 2025Updated last year
- ☆28Sep 7, 2026Updated 2 months ago
- ☆27Aug 3, 2026Updated 3 months ago
- CHERRL: A Controllable Hacking Environment for Rubric-Based Reinforcement Learning☆16Nov 10, 2026Updated last week
- [EACL 2026] TABED: Test-Time Adaptive Ensemble Drafting for Robust Speculative Decoding in LVLMs☆10Feb 6, 2026Updated 9 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆99Nov 17, 2024Updated 2 years ago
- Multilingual Reasoning Gym enables the procedural generation of perfectly parallel multilingual reasoning datasets☆14Sep 11, 2026Updated 2 months ago
- ☆16Jul 23, 2024Updated 2 years ago
- [NeurIPS 2025 Spotlight] A Token is Worth over 1,000 Tokens: Efficient Knowledge Distillation through Low-Rank Clone.☆51Oct 29, 2025Updated last year
- ☆15Apr 11, 2024Updated 2 years ago
- TReB is a reliable and comprehensive benchmark that offers assessment of LLM capabilities for table reasoning☆13Jul 30, 2026Updated 3 months ago
- Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs☆14Apr 3, 2025Updated last year
Are these results useful?