kilian-group / phantom-wikiLinks
Python package for generating datasets to evaluate reasoning and retrieval of large language models
☆18Updated 3 months ago
Alternatives and similar repositories for phantom-wiki
Users that are interested in phantom-wiki are comparing it to the libraries listed below
Sorting:
- Aioli: A unified optimization framework for language model data mixing☆32Updated 11 months ago
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆55Updated 5 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆62Updated last year
- ☆91Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 8 months ago
- Minimum Description Length probing for neural network representations☆20Updated 11 months ago
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆94Updated 7 months ago
- Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"☆31Updated 7 months ago
- The repository contains code for Adaptive Data Optimization☆30Updated last year
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆94Updated last year
- ☆80Updated 3 months ago
- Lottery Ticket Adaptation☆40Updated last year
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆26Updated 3 weeks ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆45Updated 3 months ago
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- A repository for research on medium sized language models.☆77Updated last year
- ☆75Updated last year
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆190Updated 10 months ago
- Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…☆62Updated 3 months ago
- Official repo for Learning to Reason for Long-Form Story Generation☆73Updated 8 months ago
- Verifiers for LLM Reinforcement Learning☆80Updated 8 months ago
- ☆92Updated 2 weeks ago
- ☆33Updated last year
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆87Updated last year
- UQ: Assessing Language Models on Unsolved Questions☆29Updated 4 months ago
- Simple repository for training small reasoning models☆47Updated 11 months ago
- ☆124Updated 10 months ago
- [ICML 24 NGSM workshop] Associative Recurrent Memory Transformer implementation and scripts for training and evaluation☆59Updated last week
- Using FlexAttention to compute attention with different masking patterns☆47Updated last year
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆78Updated last year