METR / eval-analysis-publicLinks
Public repository containing METR's DVC pipeline for eval data analysis
☆63Updated 2 months ago
Alternatives and similar repositories for eval-analysis-public
Users that are interested in eval-analysis-public are comparing it to the libraries listed below
Sorting:
- ☆68Updated 3 months ago
- A better way of testing, inspecting, and analyzing AI Agent traces.☆38Updated last week
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆63Updated this week
- A framework for optimizing DSPy programs with RL☆70Updated this week
- j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.☆74Updated last week
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆24Updated 2 months ago
- Interaction-first method for generating demonstrations for web-agents on any website☆41Updated last month
- Simple examples using Argilla tools to build AI☆53Updated 6 months ago
- look how they massacred my boy☆63Updated 7 months ago
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆42Updated 9 months ago
- ☆89Updated this week
- ☆28Updated 8 months ago
- Automated Capability Discovery via Foundation Model Self-Exploration☆50Updated 3 months ago
- ☆29Updated 6 months ago
- Train, tune, and infer Bamba model☆127Updated this week
- Train your own SOTA deductive reasoning model☆93Updated 3 months ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆67Updated 2 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆31Updated last month
- accompanying material for sleep-time compute paper☆92Updated last month
- Small, simple agent task environments for training and evaluation☆18Updated 7 months ago
- ☆39Updated last month
- ☆19Updated last week
- ☆50Updated last week
- Challenges for general-purpose web-browsing AI agents☆58Updated this week
- Writing Blog Posts with Generative Feedback Loops!☆48Updated last year
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆90Updated 4 months ago
- ☆41Updated 4 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆78Updated 2 months ago
- ☆59Updated this week
- Let Claude control a web browser on your machine.☆29Updated this week