AIRS-Bench: an AI Research Science benchmark for quantifying the end-to-end AI research abilities of LLM agents
☆65Feb 27, 2026Updated last week
Alternatives and similar repositories for airs-bench
Users that are interested in airs-bench are comparing it to the libraries listed below
Sorting:
- The code and datasets of our ACM MM 2024 paper "Hallu-PI: Evaluating Hallucination in Multi-modal Large Language Models within Perturbed …☆11Sep 27, 2024Updated last year
- PiFlow: Principle-aware Scientific Discovery with Multi-Agent Collaboration☆42Jan 7, 2026Updated 2 months ago
- ☆25Nov 19, 2025Updated 3 months ago
- ☆21Aug 30, 2025Updated 6 months ago
- A Text2SQL benchmark for evaluation of Large Language Models☆41Updated this week
- ☆90Oct 30, 2025Updated 4 months ago
- The first spoken long-text dataset derived from live streams, designed to reflect the redundancy-rich and conversational nature of real-w…☆12Jun 28, 2025Updated 8 months ago
- [NeurIPS ENLSP Workshop'24] CSKV: Training-Efficient Channel Shrinking for KV Cache in Long-Context Scenarios☆16Oct 18, 2024Updated last year
- ☆18Jun 10, 2025Updated 8 months ago
- A Framework for Evaluating AI Agent Safety in Realistic Environments☆30Oct 2, 2025Updated 5 months ago
- Visual tool for SPARQL queries on graphol graphs☆10Oct 3, 2018Updated 7 years ago
- [ICML 2024] Official Repository for the paper "Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models"☆10Jul 19, 2024Updated last year
- [ICLR 2026] ParallelBench: Understanding the Tradeoffs of Parallel Decoding in Diffusion LLMs☆42Updated this week
- ☆11Jun 22, 2025Updated 8 months ago
- ☆12Updated this week
- CODO is an ontology for the semantic representation and annotation of COVID-19 data in a machine-readable form for tracking history of th…☆10Apr 19, 2022Updated 3 years ago
- Symphony — A decentralized multi-agent framework that enables intelligent agents to collaborate seamlessly across heterogeneous edge devi…☆30Oct 30, 2025Updated 4 months ago
- ☆23Feb 10, 2026Updated 3 weeks ago
- The official implement of paper 《DaMo: Data Mixing Optimizer in Fine-tuning Multimodal LLMs for Mobile Phone Agents》☆29Oct 23, 2025Updated 4 months ago
- ☆49Apr 4, 2025Updated 11 months ago
- Open Data and sources for OSINT in Tajikistan☆13Jan 17, 2025Updated last year
- ☆15Mar 20, 2025Updated 11 months ago
- ☆21Jul 10, 2025Updated 7 months ago
- Official Implementation of HIMA (COLM'25)☆19Nov 25, 2025Updated 3 months ago
- Neural Operators with Applications to the Helmholtz Equation☆11Sep 19, 2024Updated last year
- ☆14Apr 14, 2025Updated 10 months ago
- ☆12Jun 11, 2025Updated 8 months ago
- ☆25Aug 19, 2025Updated 6 months ago
- a simple lakeFS webhook for pre-commit and pre-merge validation of data objects☆12Nov 9, 2023Updated 2 years ago
- The official implementation of COOPER: A Unified Model for Cooperative Perception and Reasoning in Spatial Intelligence.☆28Dec 30, 2025Updated 2 months ago
- Quickly run SchemaSpy on a database and serve the results☆10Mar 24, 2021Updated 4 years ago
- ☆11Feb 24, 2022Updated 4 years ago
- ☆12Dec 15, 2025Updated 2 months ago
- Official Implementation of MDK12-Bench: A Multi-Discipline Benchmark for Evaluating Reasoning in Multimodal Large Language Models☆12Nov 1, 2025Updated 4 months ago
- A basic DNN tutorial in PyTorch, for persons without a background in Linux, Python, or remote servers☆10Apr 2, 2020Updated 5 years ago
- Spanish text summarization demo using CoreNLP☆10Sep 13, 2014Updated 11 years ago
- Entropy-Driven GRPO with Guided Error Correction for Advantage Diversity☆22Aug 28, 2025Updated 6 months ago
- ☆13Feb 2, 2025Updated last year
- Elasticsearch plugin for Sentiment Analysis using Stanford CoreNLP☆11Oct 17, 2018Updated 7 years ago