xlang-ai / Spider2-V
[NeurIPS 2024] Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?
☆116Updated 5 months ago
Alternatives and similar repositories for Spider2-V:
Users that are interested in Spider2-V are comparing it to the libraries listed below
- Reformatted Alignment☆113Updated 4 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated 11 months ago
- 🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…☆136Updated last month
- ☆209Updated 5 months ago
- This is the code repo for our paper "Autonomously Knowledge Assimilation and Accommodation through Retrieval-Augmented Agents".☆102Updated 3 months ago
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆128Updated 2 months ago
- Conifer: Improving Complex Constrained Instruction-Following Ability of Large Language Models☆84Updated 9 months ago
- ☆120Updated 7 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆111Updated 2 months ago
- This is the official repository of the paper "OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI"☆91Updated last month
- Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"☆209Updated 3 months ago
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆131Updated 3 months ago
- Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)☆114Updated 3 months ago
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆64Updated last month
- AWM: Agent Workflow Memory☆233Updated 2 months ago
- BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval☆68Updated 3 weeks ago
- InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw☆55Updated 3 months ago
- ☆58Updated 6 months ago
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆148Updated 11 months ago
- ☆98Updated last month
- Astraios: Parameter-Efficient Instruction Tuning Code Language Models☆57Updated 9 months ago
- [EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA☆110Updated 2 months ago
- [ICLR 2025] Benchmarking Agentic Workflow Generation☆40Updated 2 months ago
- The official implementation of "Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks"☆52Updated 9 months ago
- [ACL 2024] AUTOACT: Automatic Agent Learning from Scratch for QA via Self-Planning☆203Updated 2 weeks ago
- [NeurIPS 2024] Agent Planning with World Knowledge Model☆104Updated last month
- UGround: Universal GUI Visual Grounding for GUI Agents☆147Updated this week
- Co-LLM: Learning to Decode Collaboratively with Multiple Language Models☆107Updated 8 months ago
- ☆48Updated last month
- [ICLR 2024] MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use☆76Updated 10 months ago