kilian-group / phantom-wikiLinks
Python package for generating datasets to evaluate reasoning and retrieval of large language models
☆19Updated 2 weeks ago
Alternatives and similar repositories for phantom-wiki
Users that are interested in phantom-wiki are comparing it to the libraries listed below
Sorting:
- Aioli: A unified optimization framework for language model data mixing☆27Updated 8 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated last year
- A repository for research on medium sized language models.☆78Updated last year
- Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models☆28Updated 6 months ago
- Minimum Description Length probing for neural network representations☆20Updated 8 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆43Updated last week
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 8 months ago
- Lottery Ticket Adaptation☆40Updated 10 months ago
- Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"☆27Updated 4 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 5 months ago
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆93Updated 4 months ago
- NeurIPS 2024 tutorial on LLM Inference☆47Updated 10 months ago
- CodeUltraFeedback: aligning large language models to coding preferences (TOSEM 2025)☆71Updated last year
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆55Updated 3 months ago
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆51Updated 11 months ago
- Verifiers for LLM Reinforcement Learning☆74Updated 5 months ago
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- ☆47Updated 6 months ago
- ☆74Updated last month
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆38Updated 4 months ago
- ☆47Updated last year
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆37Updated last year
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- The repository contains code for Adaptive Data Optimization☆25Updated 10 months ago
- ☆80Updated this week
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Updated last year
- Exploring limitations of LLM-as-a-judge☆19Updated last year
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆92Updated 10 months ago
- ☆16Updated 6 months ago