liutianlin0121 / decoding-time-realignment
Implementation of "Decoding-time Realignment of Language Models", ICML 2024.
☆17Updated 7 months ago
Alternatives and similar repositories for decoding-time-realignment:
Users that are interested in decoding-time-realignment are comparing it to the libraries listed below
- Long Context Extension and Generalization in LLMs☆40Updated 4 months ago
- ☆13Updated last year
- [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection☆38Updated 3 months ago
- Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)☆22Updated 2 months ago
- The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":☆34Updated 9 months ago
- [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆45Updated last month
- ☆94Updated 4 months ago
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models☆76Updated 10 months ago
- Feeling confused about super alignment? Here is a reading list☆42Updated last year
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆71Updated 7 months ago
- [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely☆20Updated 7 months ago
- A Closer Look into Mixture-of-Experts in Large Language Models☆41Updated 5 months ago
- Codebase for Instruction Following without Instruction Tuning☆33Updated 4 months ago
- OPT-Tree: Speculative Decoding with Adaptive Draft Tree Structure☆20Updated 5 months ago
- The code and data for the paper JiuZhang3.0☆40Updated 8 months ago
- Towards Systematic Measurement for Long Text Quality☆31Updated 4 months ago
- The repository of the project "Fine-tuning Large Language Models with Sequential Instructions", code base comes from open-instruct and LA…☆29Updated 2 months ago
- A method of ensemble learning for heterogeneous large language models.☆33Updated 5 months ago
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆76Updated 4 months ago
- [ACL 2023] Solving Math Word Problems via Cooperative Reasoning induced Language Models (LLMs + MCTS + Self-Improvement)☆48Updated last year
- ☆27Updated 2 months ago
- ☆48Updated 9 months ago
- Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"☆65Updated last year
- Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning☆36Updated last year
- LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation☆18Updated last week
- ☆30Updated 4 months ago
- BeHonest: Benchmarking Honesty in Large Language Models☆31Updated 5 months ago
- ☆30Updated last year
- We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.☆58Updated 3 months ago
- Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales☆31Updated last year