benediktstroebl / agent-evalsLinks
☆25Updated 3 months ago
Alternatives and similar repositories for agent-evals
Users that are interested in agent-evals are comparing it to the libraries listed below
Sorting:
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆33Updated 4 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- ☆54Updated 10 months ago
- ☆56Updated 2 months ago
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Updated last year
- UQ: Assessing Language Models on Unsolved Questions☆25Updated 2 weeks ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆92Updated this week
- Source code for the collaborative reasoner research project at Meta FAIR.☆102Updated 4 months ago
- ☆67Updated 5 months ago
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆36Updated last year
- ☆29Updated last month
- The original Shared Recurrent Memory Transformer implementation☆31Updated 2 months ago
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆50Updated 10 months ago
- Lottery Ticket Adaptation☆39Updated 9 months ago
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 7 months ago
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆61Updated 9 months ago
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆18Updated last year
- ☆40Updated 3 months ago
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- ☆28Updated 5 months ago
- LLM reads a paper and produce a working prototype☆57Updated 5 months ago
- EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…☆26Updated 9 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated 11 months ago
- Verifiers for LLM Reinforcement Learning☆72Updated 4 months ago
- ☆23Updated 11 months ago
- ☆50Updated 11 months ago
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆24Updated this week
- A testbed for agents and environments that can automatically improve models through data generation.☆27Updated 6 months ago
- ☆19Updated last month
- ☆41Updated last year