JoshuaPurtell / SmallBenchLinks
Small, simple agent task environments for training and evaluation
☆18Updated 11 months ago
Alternatives and similar repositories for SmallBench
Users that are interested in SmallBench are comparing it to the libraries listed below
Sorting:
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 8 months ago
- ☆57Updated 8 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 5 months ago
- Evaluating LLMs with CommonGen-Lite☆91Updated last year
- ☆13Updated 5 months ago
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆24Updated 2 weeks ago
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆64Updated 9 months ago
- ☆54Updated 10 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆184Updated 6 months ago
- Functional Benchmarks and the Reasoning Gap☆89Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆59Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆110Updated 9 months ago
- Official repo for Learning to Reason for Long-Form Story Generation☆72Updated 5 months ago
- Just a bunch of benchmark logs for different LLMs☆119Updated last year
- ☆40Updated last year
- ☆56Updated 3 months ago
- Simple GRPO scripts and configurations.☆59Updated 7 months ago
- ☆81Updated last week
- Project code for training LLMs to write better unit tests + code☆21Updated 4 months ago
- Repository for the paper Stream of Search: Learning to Search in Language☆151Updated 8 months ago
- Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles☆55Updated 4 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆172Updated 8 months ago
- ☆68Updated 4 months ago
- ☆24Updated 4 months ago
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆22Updated 10 months ago
- Public Inflection Benchmarks☆68Updated last year
- A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments☆89Updated this week
- Sphynx Hallucination Induction☆53Updated 8 months ago
- Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.☆32Updated 7 months ago
- ☆101Updated 8 months ago