JoshuaPurtell / SmallBenchLinks
Small, simple agent task environments for training and evaluation
☆18Updated 8 months ago
Alternatives and similar repositories for SmallBench
Users that are interested in SmallBench are comparing it to the libraries listed below
Sorting:
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated 10 months ago
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆58Updated 7 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆54Updated 5 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆32Updated 2 months ago
- Just a bunch of benchmark logs for different LLMs☆119Updated 11 months ago
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆23Updated 3 months ago
- ☆52Updated 8 months ago
- Official repo for Learning to Reason for Long-Form Story Generation☆65Updated 2 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆106Updated 7 months ago
- Functional Benchmarks and the Reasoning Gap☆88Updated 9 months ago
- ☆93Updated last month
- Data preparation code for CrystalCoder 7B LLM☆45Updated last year
- Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.☆41Updated 2 months ago
- Lego for GRPO☆28Updated last month
- Evaluating LLMs with CommonGen-Lite☆90Updated last year
- ☆52Updated last week
- Verifiers for LLM Reinforcement Learning☆64Updated 2 months ago
- ☆50Updated 2 weeks ago
- Pre-training code for CrystalCoder 7B LLM☆54Updated last year
- Simple GRPO scripts and configurations.☆59Updated 5 months ago
- EvaByte: Efficient Byte-level Language Models at Scale☆103Updated 2 months ago
- ☆35Updated last year
- ☆47Updated last year
- ☆38Updated 11 months ago
- ☆69Updated last month
- ☆117Updated 4 months ago
- ☆41Updated 5 months ago
- The first dense retrieval model that can be prompted like an LM☆80Updated 2 months ago
- ☆128Updated 3 months ago
- ☆17Updated 5 months ago