Hritikbansal / jpo
☆12Updated 3 weeks ago
Alternatives and similar repositories for jpo:
Users that are interested in jpo are comparing it to the libraries listed below
- Lightweight Adapting for Black-Box Large Language Models☆19Updated 11 months ago
- Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."☆38Updated 2 months ago
- ☆29Updated 8 months ago
- Code&Data for the paper "Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization"☆11Updated 6 months ago
- Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning with LLMs☆32Updated 11 months ago
- ☆16Updated 6 months ago
- Restore safety in fine-tuned language models through task arithmetic☆26Updated 9 months ago
- [EMNLP 2024] Official implementation of "Hierarchical Deconstruction of LLM Reasoning: A Graph-Based Framework for Analyzing Knowledge Ut…☆21Updated last month
- ☆25Updated last year
- The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".☆32Updated last year
- [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$☆38Updated 2 months ago
- Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆39Updated last month
- Long Context Extension and Generalization in LLMs☆40Updated 3 months ago
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆41Updated 5 months ago
- Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization☆18Updated 3 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs?☆26Updated 7 months ago
- ☆13Updated 4 months ago
- Visual and Embodied Concepts evaluation benchmark☆21Updated last year
- Self-Supervised Alignment with Mutual Information☆16Updated 7 months ago
- ☆14Updated last year
- The code of “Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning”☆15Updated 10 months ago
- Mosaic IT: Enhancing Instruction Tuning with Data Mosaics☆17Updated 6 months ago
- This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…☆22Updated 3 months ago
- [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆42Updated last month
- ☆26Updated 9 months ago
- ☆40Updated last year
- ☆36Updated last year
- Public code repo for paper "Aligning LLMs with Individual Preferences via Interaction"☆18Updated 3 months ago
- This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…☆20Updated last month
- One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning☆38Updated last year