songmzhang / DSKD
Repo for Paper "Dual-Space Knowledge Distillation for Large Language Models".
☆29Updated 2 weeks ago
Related projects: ⓘ
- [ICML'2024] Can AI Assistants Know What They Don't Know?☆62Updated 7 months ago
- [ACL 2024] A Prospector of Long-Dependency Data for Large Language Models☆48Updated last month
- The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":☆31Updated 5 months ago
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models☆72Updated 6 months ago
- ☆31Updated 3 months ago
- One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning☆36Updated last year
- Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process☆17Updated last month
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆62Updated 3 months ago
- This the implementation of LeCo☆16Updated 2 months ago
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆34Updated 2 months ago
- Source code of "Reasons to Reject? Aligning Language Models with Judgments"☆54Updated 6 months ago
- 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training☆79Updated this week
- Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"☆56Updated 6 months ago
- ☆87Updated 4 months ago
- ☆23Updated 2 months ago
- Code for Suri: Multi-constraint instruction following for long-form text generation☆15Updated last week
- ☆71Updated 8 months ago
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆33Updated 6 months ago
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆134Updated 3 months ago
- Code and data for "Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue" (ACL 2024)☆20Updated last month
- ☆15Updated last week
- Towards Systematic Measurement for Long Text Quality☆27Updated 2 weeks ago
- Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".☆22Updated 5 months ago
- Code for paper "Patch-Level Training for Large Language Models"☆59Updated 2 months ago
- Methods and evaluation for aligning language models temporally☆24Updated 6 months ago
- Fantastic Data Engineering for Large Language Models☆38Updated last month
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆38Updated 2 months ago
- This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"☆21Updated 2 months ago
- Code for M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models☆22Updated last month
- A method of ensemble learning for heterogeneous large language models.☆25Updated last month