oriyor / assistantbenchLinks
Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
☆66Updated 11 months ago
Alternatives and similar repositories for assistantbench
Users that are interested in assistantbench are comparing it to the libraries listed below
Sorting:
- ☆41Updated last year
- ☆124Updated 9 months ago
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆94Updated 6 months ago
- ☆86Updated last year
- ☆87Updated this week
- The first dense retrieval model that can be prompted like an LM☆89Updated 6 months ago
- ☆49Updated 7 months ago
- Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."☆66Updated 2 years ago
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆91Updated last year
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆55Updated 4 months ago
- ☆62Updated 5 months ago
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 9 months ago
- ☆90Updated 3 weeks ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆173Updated 10 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆189Updated 8 months ago
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆51Updated last year
- Verifiers for LLM Reinforcement Learning☆80Updated 7 months ago
- Functional Benchmarks and the Reasoning Gap☆90Updated last year
- ☆29Updated 3 months ago
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆37Updated 11 months ago
- accompanying material for sleep-time compute paper☆117Updated 7 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆110Updated 11 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 7 months ago
- ☆55Updated last year
- ☆24Updated last year
- Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles☆60Updated 6 months ago
- WebLINX is a benchmark for building web navigation agents with conversational capabilities☆156Updated 9 months ago
- EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…☆27Updated 11 months ago
- ☆35Updated 6 months ago