Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
☆70Dec 9, 2024Updated last year
Alternatives and similar repositories for assistantbench
Users that are interested in assistantbench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2024 D&B] VideoGUI: A Benchmark for GUI Automation from Instructional Videos☆51Feb 22, 2026Updated last month
- Very minimal (and stateless) agent framework☆44Jan 12, 2025Updated last year
- [NAACL'25] "Revealing the Barriers of Language Agents in Planning"☆13Jun 22, 2025Updated 9 months ago
- Align, a general text alignment function☆15Dec 7, 2023Updated 2 years ago
- Host CIFAR-10.2 Data Set☆13Sep 22, 2021Updated 4 years ago
- A Python implementation of an agent swarm system that works with local LLM servers. The system allows you to create multiple agents that …☆12Nov 20, 2024Updated last year
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Feb 23, 2024Updated 2 years ago
- NeurIPS 2024: SciFIBench: Benchmarking Large Multimodal Models for Scientific Figure Interpretation☆13May 24, 2025Updated 10 months ago
- ☆28Oct 31, 2023Updated 2 years ago
- WebLINX is a benchmark for building web navigation agents with conversational capabilities☆161Feb 11, 2025Updated last year
- Open-source repository for the OOPSLA'24 paper "CYCLE: Learning to Self-Refine Code Generation"☆10Mar 8, 2024Updated 2 years ago
- Evaluating and improving the faithfulness of the interpretations offered by Neural Module Networks☆13Jun 12, 2023Updated 2 years ago
- Mitigating Open-Vocabulary Caption Hallucinations (EMNLP 2024)☆18Oct 18, 2024Updated last year
- ☆13Dec 12, 2025Updated 3 months ago
- VisualWebArena is a benchmark for multimodal agents.☆450Nov 9, 2024Updated last year
- ☆22Apr 12, 2022Updated 3 years ago
- EMNLP 2024: Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue☆38May 26, 2025Updated 9 months ago
- Diverse Demonstrations Improve In-context Compositional Generalization☆12Jul 7, 2023Updated 2 years ago
- Official repository of the paper MPMQA: Multimodal Question Answering on Product Manuals (AAAI 2023)☆19Nov 28, 2022Updated 3 years ago
- Multi-Task Speech classification of accent and gender of an english speaker on Mozilla's common voice dataset☆27May 30, 2025Updated 9 months ago
- ☆34Mar 5, 2026Updated 2 weeks ago
- ☆132Jul 8, 2024Updated last year
- ☆12Nov 5, 2024Updated last year
- a set of scripts to easily convert all training data from huggingface into alpaca instruct or sharegpt format, which should allow for eas…☆18Mar 14, 2025Updated last year
- ☆75Mar 15, 2026Updated last week
- ☆20Jan 14, 2022Updated 4 years ago
- OfficeBench: Benchmarking Language Agents across Multiple Applications for Office Automation☆33May 23, 2025Updated 10 months ago
- Project code for training LLMs to write better unit tests + code☆21May 19, 2025Updated 10 months ago
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆37Dec 29, 2024Updated last year
- [NeurIPS 2024] PyTorch code for the paper "Making Offline RL Online: Collaborative World Models for Offline Visual Reinforcement Learning…☆24Oct 24, 2025Updated 5 months ago
- ☆12Oct 2, 2020Updated 5 years ago
- Tool4AI: A model agnostic, LLM friendly router for tool/function call☆20Aug 19, 2024Updated last year
- A benchmark dataset and simple code examples for measuring the perception and reasoning of multi-sensor Vision Language models.☆19Dec 27, 2024Updated last year
- 🌎💪 BrowserGym, a Gym environment for web task automation☆1,162Mar 17, 2026Updated last week
- Code for the paper 🌳 Tree Search for Language Model Agents☆220Jul 25, 2024Updated last year
- Github repository for ACL 2025 paper: VoxEval: Benchmarking the Knowledge Understanding Capabilities of End-to-End Spoken Language Models☆24Jun 16, 2025Updated 9 months ago
- Code to reproduce LREC Paper Simplifying Semantic Annotations of SMCalFlow☆25Mar 28, 2024Updated last year
- ☆69Dec 15, 2024Updated last year
- RACE is a multi-dimensional benchmark for code generation that focuses on Readability, mAintainability, Correctness, and Efficiency.☆12Oct 12, 2024Updated last year