kilian-group / phantom-wikiLinks
Python package for generating datasets to evaluate reasoning and retrieval of large language models
☆19Updated 2 months ago
Alternatives and similar repositories for phantom-wiki
Users that are interested in phantom-wiki are comparing it to the libraries listed below
Sorting:
- Aioli: A unified optimization framework for language model data mixing☆28Updated 10 months ago
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆56Updated 4 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 7 months ago
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆38Updated 5 months ago
- A repository for research on medium sized language models.☆78Updated last year
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆94Updated 6 months ago
- Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models☆29Updated 7 months ago
- Minimum Description Length probing for neural network representations☆20Updated 9 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated last year
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆91Updated last year
- Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…☆59Updated last month
- Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"☆29Updated 5 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆44Updated last month
- Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044☆35Updated last year
- ☆88Updated last year
- ☆124Updated 9 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆85Updated last year
- Using FlexAttention to compute attention with different masking patterns☆47Updated last year
- Lottery Ticket Adaptation☆40Updated last year
- ☆82Updated this week
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆51Updated last year
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆101Updated this week
- ☆55Updated last year
- The repository contains code for Adaptive Data Optimization☆28Updated 11 months ago
- ☆52Updated last year
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- Verifiers for LLM Reinforcement Learning☆79Updated 7 months ago
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆24Updated last week
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆60Updated last year