liutianlin0121 / decoding-time-realignment
Implementation of "Decoding-time Realignment of Language Models", ICML 2024.
☆13Updated 3 months ago
Related projects: ⓘ
- [NeurIPS 2023] Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective☆29Updated 11 months ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆38Updated 2 months ago
- Towards Systematic Measurement for Long Text Quality☆27Updated 2 weeks ago
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆34Updated 2 months ago
- Code for Suri: Multi-constraint instruction following for long-form text generation☆15Updated last week
- ☆87Updated 4 months ago
- Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".☆22Updated 5 months ago
- Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆20Updated 2 months ago
- Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning☆35Updated last year
- [ICML'2024] Can AI Assistants Know What They Don't Know?☆62Updated 7 months ago
- ☆14Updated 11 months ago
- 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training☆79Updated this week
- Source code of "Reasons to Reject? Aligning Language Models with Judgments"☆54Updated 6 months ago
- The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":☆31Updated 5 months ago
- ☆23Updated 2 months ago
- BeHonest: Benchmarking Honesty in Large Language Models☆27Updated last month
- Code for M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models☆22Updated last month
- Code for ACL 2023 paper titled "Lifting the Curse of Capacity Gap in Distilling Language Models"☆28Updated last year
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆33Updated 6 months ago
- ☆28Updated last year
- ☆16Updated 6 months ago
- This the implementation of LeCo☆16Updated 2 months ago
- [ACL 2023] Solving Math Word Problems via Cooperative Reasoning induced Language Models☆33Updated 9 months ago
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆62Updated 3 months ago
- ☆32Updated 5 months ago
- Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"☆22Updated 3 months ago
- Use the tokenizer in parallel to achieve superior acceleration☆15Updated 6 months ago
- ☆31Updated 5 months ago
- Explore what LLMs are really leanring over SFT☆26Updated 5 months ago
- Official implementation for the paper *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*☆57Updated 3 weeks ago