oriyor / assistantbenchLinks
Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
☆64Updated 9 months ago
Alternatives and similar repositories for assistantbench
Users that are interested in assistantbench are comparing it to the libraries listed below
Sorting:
- ☆41Updated last year
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆93Updated 4 months ago
- ☆123Updated 7 months ago
- Functional Benchmarks and the Reasoning Gap☆89Updated last year
- ☆77Updated last week
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆59Updated last year
- Verifiers for LLM Reinforcement Learning☆74Updated 5 months ago
- ☆86Updated last year
- The first dense retrieval model that can be prompted like an LM☆89Updated 4 months ago
- ☆47Updated 5 months ago
- [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆106Updated 3 months ago
- ☆81Updated last week
- Mixing Language Models with Self-Verification and Meta-Verification☆110Updated 9 months ago
- Repository for the paper Stream of Search: Learning to Search in Language☆151Updated 8 months ago
- accompanying material for sleep-time compute paper☆115Updated 5 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆172Updated 8 months ago
- WebLINX is a benchmark for building web navigation agents with conversational capabilities☆158Updated 7 months ago
- Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044☆35Updated last year
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆51Updated 11 months ago
- ☆56Updated 3 months ago
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆37Updated 9 months ago
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆55Updated 2 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆184Updated 6 months ago
- ☆23Updated last year
- Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"☆130Updated last year
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 7 months ago
- Interaction-first method for generating demonstrations for web-agents on any website☆50Updated 5 months ago
- ☆29Updated last month
- Source code for the collaborative reasoner research project at Meta FAIR.☆103Updated 5 months ago