oriyor / assistantbenchLinks
Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
☆61Updated 9 months ago
Alternatives and similar repositories for assistantbench
Users that are interested in assistantbench are comparing it to the libraries listed below
Sorting:
- ☆41Updated last year
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆93Updated 3 months ago
- Repository for the paper Stream of Search: Learning to Search in Language☆150Updated 7 months ago
- Functional Benchmarks and the Reasoning Gap☆88Updated 11 months ago
- Verifiers for LLM Reinforcement Learning☆72Updated 4 months ago
- ☆122Updated 6 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- ☆86Updated last year
- The first dense retrieval model that can be prompted like an LM☆86Updated 4 months ago
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆37Updated 8 months ago
- ☆46Updated 5 months ago
- ☆79Updated last week
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆55Updated 2 months ago
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 7 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆182Updated 6 months ago
- Official repo for Learning to Reason for Long-Form Story Generation☆68Updated 4 months ago
- Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…☆52Updated 4 months ago
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆96Updated 5 months ago
- WebLINX is a benchmark for building web navigation agents with conversational capabilities☆157Updated 7 months ago
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆50Updated 10 months ago
- ☆71Updated 2 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆110Updated 9 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆33Updated 4 months ago
- ☆52Updated 10 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆143Updated 9 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆172Updated 7 months ago
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples☆105Updated last month
- ☆54Updated 10 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆48Updated last year