allenai / recomaLinks
Reasoning by Communicating with Agents
☆29Updated 8 months ago
Alternatives and similar repositories for recoma
Users that are interested in recoma are comparing it to the libraries listed below
Sorting:
- A set of utilities for running few-shot prompting experiments on large-language models☆126Updated 2 years ago
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆101Updated 2 years ago
- Evaluating LLMs with CommonGen-Lite☆93Updated last year
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆118Updated 2 months ago
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆65Updated last year
- LILO: Library Induction with Language Observations☆90Updated last year
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆117Updated last month
- Computer Agent Arena: Test & compare AI agents in real desktop apps & web environments. Code/data coming soon!☆51Updated 9 months ago
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆37Updated last year
- Small, simple agent task environments for training and evaluation☆19Updated last year
- Retrieval Augmented Generation Generalized Evaluation Dataset☆59Updated 5 months ago
- Open Implementations of LLM Analyses☆107Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆111Updated last year
- Evaluating tool-augmented LLMs in conversation settings☆88Updated last year
- LLMs as Collaboratively Edited Knowledge Bases☆46Updated last year
- DialOp: Decision-oriented dialogue environments for collaborative language agents☆111Updated last year
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆51Updated last year
- [NAACL 2024] Struc-Bench: Are Large Language Models Good at Generating Complex Structured Tabular Data? https://aclanthology.org/2024.naa…☆55Updated 5 months ago
- ☆96Updated last week
- 🔔🧠 Easily experiment with popular language agents across diverse reasoning/decision-making benchmarks!☆53Updated 6 months ago
- Codebase accompanying the Summary of a Haystack paper.☆80Updated last year
- Scalable Meta-Evaluation of LLMs as Evaluators☆43Updated last year
- Code and data for the paper "Why think step by step? Reasoning emerges from the locality of experience"☆63Updated 9 months ago
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆43Updated 2 years ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 8 months ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆45Updated last year
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).☆80Updated last year
- ☆41Updated last year
- This project studies the performance and robustness of language models and task-adaptation methods.☆155Updated last year
- [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation☆49Updated 2 years ago