Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
☆70Dec 9, 2024Updated last year
Alternatives and similar repositories for assistantbench
Users that are interested in assistantbench are comparing it to the libraries listed below
Sorting:
- Anthropic Computer Use with Modal Sandboxes☆44Oct 23, 2024Updated last year
- ☆13Nov 21, 2025Updated 3 months ago
- Very minimal (and stateless) agent framework☆44Jan 12, 2025Updated last year
- [NeurIPS 2024 D&B] VideoGUI: A Benchmark for GUI Automation from Instructional Videos☆51Feb 22, 2026Updated last week
- Align, a general text alignment function☆15Dec 7, 2023Updated 2 years ago
- ☆12Nov 5, 2024Updated last year
- ☆33Feb 15, 2026Updated 2 weeks ago
- WebLINX is a benchmark for building web navigation agents with conversational capabilities☆160Feb 11, 2025Updated last year
- NeurIPS 2024: SciFIBench: Benchmarking Large Multimodal Models for Scientific Figure Interpretation☆13May 24, 2025Updated 9 months ago
- Tool4AI: A model agnostic, LLM friendly router for tool/function call☆19Aug 19, 2024Updated last year
- VisualWebArena is a benchmark for multimodal agents.☆440Nov 9, 2024Updated last year
- Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding☆53Dec 12, 2024Updated last year
- Host CIFAR-10.2 Data Set☆13Sep 22, 2021Updated 4 years ago
- A visual tool to interpret and understand PyTorch machine learning models☆17Feb 11, 2024Updated 2 years ago
- ☆17Jul 22, 2024Updated last year
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Feb 23, 2024Updated 2 years ago
- ☆19Aug 23, 2024Updated last year
- ☆13May 10, 2022Updated 3 years ago
- a set of scripts to easily convert all training data from huggingface into alpaca instruct or sharegpt format, which should allow for eas…☆18Mar 14, 2025Updated 11 months ago
- Official repository of the paper MPMQA: Multimodal Question Answering on Product Manuals (AAAI 2023)☆18Nov 28, 2022Updated 3 years ago
- Official code for the paper "CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modules"☆49Nov 10, 2025Updated 3 months ago
- [NeurIPS 2024] PyTorch code for the paper "Making Offline RL Online: Collaborative World Models for Offline Visual Reinforcement Learning…☆23Oct 24, 2025Updated 4 months ago
- CiteME is a benchmark designed to test the abilities of language models in finding papers that are cited in scientific texts.☆48Nov 3, 2025Updated 4 months ago
- [ACL 2025] AgentStore: Scalable Integration of Heterogeneous Agents As Specialized Generalist Computer Assistant☆44Dec 19, 2024Updated last year
- Democratizing Function Calling Capabilities for Open-Source Language Models☆42May 5, 2024Updated last year
- Project code for training LLMs to write better unit tests + code☆21May 19, 2025Updated 9 months ago
- [KDD 2020] This is the code repository for our KDD'20 paper STEAM: Self-Supervised Taxonomy Expansion with Mini-Paths.☆18Jul 22, 2020Updated 5 years ago
- A benchmark dataset and simple code examples for measuring the perception and reasoning of multi-sensor Vision Language models.☆19Dec 27, 2024Updated last year
- Github repository for ACL 2025 paper: VoxEval: Benchmarking the Knowledge Understanding Capabilities of End-to-End Spoken Language Models☆24Jun 16, 2025Updated 8 months ago
- CIFAR-10-Warehouse: Towards Broad and More Realistic Testbeds in Model Generalization Analysis☆18Jul 15, 2024Updated last year
- ☆23Jan 25, 2023Updated 3 years ago
- ☆73Feb 8, 2026Updated 3 weeks ago
- ☆31Jul 3, 2025Updated 8 months ago
- Universal Reasoning Model☆125Jan 15, 2026Updated last month
- [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation☆49Dec 22, 2023Updated 2 years ago
- An agent benchmark with tasks in a simulated software company.☆646Nov 17, 2025Updated 3 months ago
- This repository `II-Commons` contains tools for managing text and image datasets, including loading, fetching, and embedding large datase…☆33Jul 22, 2025Updated 7 months ago
- This repository includes various baseline techniques for label-free model evaluation task for the VDU2023 competition.☆19Mar 8, 2023Updated 2 years ago
- Code for paper "Point and Ask: Incorporating Pointing into Visual Question Answering"☆19Oct 4, 2022Updated 3 years ago