benediktstroebl / agent-evalsLinks
☆23Updated 2 months ago
Alternatives and similar repositories for agent-evals
Users that are interested in agent-evals are comparing it to the libraries listed below
Sorting:
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated 11 months ago
- ☆53Updated 8 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆32Updated 3 months ago
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆36Updated last year
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Updated last year
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆17Updated last year
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆51Updated 3 weeks ago
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 5 months ago
- LLM reads a paper and produce a working prototype☆58Updated 3 months ago
- ☆54Updated last month
- Source code for the collaborative reasoner research project at Meta FAIR.☆99Updated 3 months ago
- ☆24Updated 10 months ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆43Updated last year
- accompanying material for sleep-time compute paper☆99Updated 3 months ago
- Simple repository for training small reasoning models☆32Updated 5 months ago
- ☆47Updated 10 months ago
- ☆66Updated 4 months ago
- EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…☆26Updated 7 months ago
- Verifiers for LLM Reinforcement Learning☆68Updated 3 months ago
- Lottery Ticket Adaptation☆39Updated 8 months ago
- ☆70Updated 2 weeks ago
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- Tree prompting: easy-to-use scikit-learn interface for improved prompting.☆39Updated last year
- ☆27Updated last year
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆59Updated 7 months ago
- Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models☆24Updated 4 months ago
- ☆40Updated 7 months ago
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆49Updated 9 months ago
- ☆63Updated 3 weeks ago
- KV Cache Steering for Inducing Reasoning in Small Language Models☆35Updated last week