ZeroSumEval / ZeroSumEvalLinks
A framework for pitting LLMs against each other in an evolving library of games ⚔
☆34Updated 6 months ago
Alternatives and similar repositories for ZeroSumEval
Users that are interested in ZeroSumEval are comparing it to the libraries listed below
Sorting:
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆21Updated last year
- ☆55Updated 11 months ago
- ☆80Updated last week
- ☆102Updated 9 months ago
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆63Updated 10 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆58Updated last week
- Official repo for Learning to Reason for Long-Form Story Generation☆72Updated 6 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆109Updated 10 months ago
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 8 months ago
- Small, simple agent task environments for training and evaluation☆18Updated 11 months ago
- 🔔🧠 Easily experiment with popular language agents across diverse reasoning/decision-making benchmarks!☆54Updated 3 months ago
- Simple GRPO scripts and configurations.☆59Updated 8 months ago
- Functional Benchmarks and the Reasoning Gap☆89Updated last year
- An attribution library for LLMs☆43Updated last year
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆43Updated 3 weeks ago
- Aioli: A unified optimization framework for language model data mixing☆27Updated 9 months ago
- LLM reads a paper and produce a working prototype☆57Updated 6 months ago
- ☆25Updated 5 months ago
- Supercharge huggingface transformers with model parallelism.☆77Updated 3 months ago
- ☆68Updated 3 weeks ago
- Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles☆58Updated 5 months ago
- Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…☆56Updated 3 weeks ago
- Verifiers for LLM Reinforcement Learning☆76Updated 6 months ago
- Python package for generating datasets to evaluate reasoning and retrieval of large language models☆19Updated last month
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- Learning to route instances for Human vs AI Feedback (ACL Main '25)☆24Updated 3 months ago
- ☆29Updated 2 months ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆102Updated 6 months ago
- Sphynx Hallucination Induction☆53Updated 8 months ago