allenai / recomaLinks
Reasoning by Communicating with Agents
☆30Updated 4 months ago
Alternatives and similar repositories for recoma
Users that are interested in recoma are comparing it to the libraries listed below
Sorting:
- A set of utilities for running few-shot prompting experiments on large-language models☆122Updated last year
- Computer Agent Arena: Test & compare AI agents in real desktop apps & web environments. Code/data coming soon!☆50Updated 5 months ago
- Evaluating LLMs with CommonGen-Lite☆91Updated last year
- Evaluating tool-augmented LLMs in conversation settings☆88Updated last year
- Small, simple agent task environments for training and evaluation☆18Updated 10 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆62Updated 9 months ago
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆37Updated 8 months ago
- ☆67Updated 5 months ago
- [NeurIPS 2024] Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?☆130Updated last year
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆97Updated 5 months ago
- ☆41Updated last year
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆116Updated last year
- Run SWE-bench evaluations remotely☆42Updated last month
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆97Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- 🔔🧠 Easily experiment with popular language agents across diverse reasoning/decision-making benchmarks!☆54Updated 2 months ago
- Verifiers for LLM Reinforcement Learning☆72Updated 5 months ago
- Code and Dataset for Learning to Solve Complex Tasks by Talking to Agents☆24Updated 3 years ago
- Open Implementations of LLM Analyses☆107Updated 11 months ago
- Data preparation code for CrystalCoder 7B LLM☆45Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆33Updated 5 months ago
- Pre-training code for CrystalCoder 7B LLM☆55Updated last year
- This project studies the performance and robustness of language models and task-adaptation methods.☆152Updated last year
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆105Updated 6 months ago
- Moatless Testbeds allows you to create isolated testbed environments in a Kubernetes cluster where you can apply code changes through git…☆15Updated 5 months ago
- A lightweight script for processing HTML page to markdown format with support for code blocks☆80Updated last year
- LLMs as Collaboratively Edited Knowledge Bases☆45Updated last year
- ☆57Updated 11 months ago
- Retrieval Augmented Generation Generalized Evaluation Dataset☆55Updated 2 months ago