[NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
☆67Dec 10, 2024Updated last year
Alternatives and similar repositories for weak-to-strong-search
Users that are interested in weak-to-strong-search are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ACL'24, Outstanding Paper] Emulated Disalignment: Safety Alignment for Large Language Models May Backfire!☆39Aug 2, 2024Updated 2 years ago
- ☆12Jul 25, 2023Updated 3 years ago
- [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection☆56Oct 29, 2024Updated last year
- [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization☆101Aug 20, 2024Updated last year
- ☆74Apr 2, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Code for ICLR 2025 Paper "GenARM: Reward Guided Generation with Autoregressive Reward Model for Test-time Alignment"☆25Feb 10, 2025Updated last year
- Correcting Chinese Spelling Errors with Phonetic Pre-training 非官方实现☆40Feb 11, 2022Updated 4 years ago
- [ICML 2025] Official implementation of the paper "SkipGPT: Dynamic Layer Pruning Reinvented with Token Awareness and Module Decoupling". …☆21Nov 17, 2025Updated 8 months ago
- Bayesian scaling laws for in-context learning.☆16Mar 12, 2025Updated last year
- This the implementation of LeCo☆33Jan 20, 2025Updated last year
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆134Mar 30, 2024Updated 2 years ago
- Rewarded soups official implementation☆64Sep 27, 2023Updated 2 years ago
- Modified LLaVA framework for MOSS2, and makes MOSS2 a multimodal model.☆13Sep 19, 2024Updated last year
- Implementation of Direct Preference Optimization☆17Jul 17, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- [ICML 2025] Emergent Response Planning in LLMs☆20Jul 1, 2025Updated last year
- ☆11Nov 13, 2024Updated last year
- awesome-LLM-controlled-constrained-generation☆57Aug 16, 2024Updated last year
- [COLM'25] A Controlled Study on Long Context Extension and Generalization in LLMs☆65Mar 9, 2026Updated 5 months ago
- Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)☆68Oct 18, 2024Updated last year
- [ICLR 2025 Spotlight] Weak-to-strong preference optimization: stealing reward from weak aligned model☆18Feb 24, 2025Updated last year
- Code for paper: Aligning Large Language Models with Representation Editing: A Control Perspective☆35Jan 31, 2025Updated last year
- ☆33Feb 10, 2025Updated last year
- ☆22Feb 4, 2026Updated 6 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆11Feb 3, 2025Updated last year
- [NeurIPS 2024 Oral] Aligner: Efficient Alignment by Learning to Correct☆196Jan 16, 2025Updated last year
- The repository for our paper: Neighboring Perturbations of Knowledge Editing on Large Language Models☆16May 4, 2024Updated 2 years ago
- Official implementation for "RSafe: Incentivizing proactive reasoning to build robust and adaptive LLM safeguards"☆17Jan 31, 2026Updated 6 months ago
- Responsible Robotic Manipulation☆17Aug 31, 2025Updated 11 months ago
- [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".☆85Jan 14, 2025Updated last year
- ☆20Nov 3, 2024Updated last year
- ☆13Jun 26, 2024Updated 2 years ago
- The official implementation of "Well Begun is Half Done: Low-resource Preference Alignment by Weak-to-Strong Decoding"☆22Jun 26, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.☆137Mar 21, 2025Updated last year
- Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning with LLMs☆41Jan 30, 2024Updated 2 years ago
- Source code for the TMLR paper "Black-Box Prompt Learning for Pre-trained Language Models"☆59Sep 7, 2023Updated 2 years ago
- The repo of "Improving Seq2Seq Grammatical Error Correction via Decoding Interventions"☆32Jan 22, 2024Updated 2 years ago
- This repository is the implementation of the paper Training Free Pretrained Model Merging (CVPR2024).☆34Mar 5, 2024Updated 2 years ago
- Code for NAACL 2025 paper "AdaCAD: Adaptively Decoding to Balance Conflicts between Contextual and Parametric Knowledge"☆16Mar 2, 2026Updated 5 months ago
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆532Oct 20, 2024Updated last year