ContextualAI / CLAIR_and_APOLinks
Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
☆59Updated last year
Alternatives and similar repositories for CLAIR_and_APO
Users that are interested in CLAIR_and_APO are comparing it to the libraries listed below
Sorting:
- ☆54Updated 10 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆44Updated last year
- A repository for research on medium sized language models.☆78Updated last year
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 7 months ago
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆89Updated last year
- ☆127Updated last year
- Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"☆45Updated last year
- MEXMA: Token-level objectives improve sentence representations☆41Updated 8 months ago
- Verifiers for LLM Reinforcement Learning☆74Updated 5 months ago
- Functional Benchmarks and the Reasoning Gap☆89Updated last year
- ☆81Updated last week
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆48Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- ☆123Updated 7 months ago
- Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044☆35Updated last year
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆92Updated 10 months ago
- ☆48Updated last year
- This is the official repository for Inheritune.☆113Updated 7 months ago
- ☆77Updated last week
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated last year
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Updated 2 years ago
- ☆85Updated last year
- The repository contains code for Adaptive Data Optimization☆25Updated 9 months ago
- Improving Text Embedding of Language Models Using Contrastive Fine-tuning☆64Updated last year
- Replicating O1 inference-time scaling laws☆90Updated 10 months ago
- ☆39Updated last year
- Aioli: A unified optimization framework for language model data mixing☆27Updated 8 months ago
- ☆29Updated last month
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆51Updated 11 months ago
- Evaluating LLMs with fewer examples☆161Updated last year