This repository contains ScholarQABench data and evaluation pipeline.
☆166Aug 13, 2025Updated last year
Alternatives and similar repositories for ScholarQABench
Users that are interested in ScholarQABench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository contains expert evaluation interface and data evaluation script for the OpenScholar project.☆42Nov 19, 2024Updated last year
- This repository includes the official implementation of OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMs.☆1,605Aug 13, 2025Updated last year
- ☆18Sep 15, 2025Updated last year
- ScienceMeter: Tracking Scientific Knowledge Updates in Language Models, COLM 2026☆17Jun 28, 2025Updated last year
- Repo housing the open sourced code for the ai2 scholar qa app and also the corresponding library☆282Jun 25, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Python package for serving a local search engine. One command to download and serve a datastore---that's it 😎.☆26Jun 6, 2025Updated last year
- Code for the paper SciCo: Hierarchical Cross-Document Coreference for Scientific Concepts (AKBC 2021). https://openreview.net/forum?id=OF…☆29Oct 17, 2021Updated 4 years ago
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆111Dec 2, 2024Updated last year
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆226Dec 16, 2025Updated 9 months ago
- Official repository for DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Research☆710Sep 9, 2026Updated 2 weeks ago
- Röttger et al. (2024): "IssueBench: Millions of Realistic Prompts for Measuring Issue Bias in LLM Writing Assistance"☆17Mar 6, 2026Updated 6 months ago
- A benchmark to evaluate search-augmented LLMs☆17Aug 28, 2025Updated last year
- An Agentic AI Framework for Ingestion and Standardization of Single-Cell RNA-seq Data Analysis☆91Aug 6, 2026Updated last month
- Multi-LexSum is an abstractive summarization dataset for US Civil Rights Lawsuits☆23Dec 15, 2022Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Code and Data for PeerQA: A Scientific Question Answering Dataset from Peer Reviews, NAACL 2025 https://aclanthology.org/2025.naacl-long.…☆16Jun 1, 2026Updated 3 months ago
- ☆19Jul 21, 2025Updated last year
- Benchmark dataset for the evaluation of scientific article representations on the task of citation recommendation across various scientif…☆12Oct 21, 2022Updated 3 years ago
- The official implementation of our work SQLFixAgent: Towards Semantic-Accurate Text-to-SQL Parsing via Consistency-Enhanced Multi-Agent C…☆27May 2, 2025Updated last year
- Code for "Foundation Models Improve Perturbation Response Prediction"☆29Apr 16, 2026Updated 5 months ago
- ☆10Dec 11, 2024Updated last year
- ☆154Aug 3, 2026Updated last month
- ☆21Aug 17, 2026Updated last month
- Code accompanying the manuscript "Broad transcriptomic dysregulation across the cerebral cortex in ASD".☆14Aug 10, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ACL 2025] Uncovering the Impact of Chain-of-Thought Reasoning for Direct Preference Optimization: Lessons from Text-to-SQL☆17Oct 9, 2025Updated 11 months ago
- ☆19Oct 17, 2024Updated last year
- Repository for the CODAH dataset☆22Oct 29, 2022Updated 3 years ago
- Cytometry by time-of-flight(CyTOF) data is very useful in studying the presence/absence of antigens/surface markers at single cell level.…☆15Jun 1, 2020Updated 6 years ago
- An exploration of a few AI authors and the data Semantic Scholar has about their citations.☆31Feb 16, 2023Updated 3 years ago
- [NeurIPS 2025 Spotlight] Co-Evolving LLM Coder and Unit Tester via Reinforcement Learning☆168Sep 19, 2025Updated last year
- ☆36Sep 7, 2026Updated 2 weeks ago
- ☆138Sep 3, 2026Updated 3 weeks ago
- A web interface for the LLMAIx framework. Information Extraction.☆23Sep 15, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Resolving Knowledge Conflicts in Large Language Models, COLM 2024☆18Oct 7, 2025Updated 11 months ago
- Benchmark and execution environment for evaluating LLM agents on end-to-end AI Research. [ICLR 2026]☆42May 31, 2026Updated 3 months ago
- Efficient multi-prompt evaluation of LLMs☆34Dec 6, 2024Updated last year
- Some CSS experiments for arXiv HTML documents converted via latexml☆21Aug 23, 2026Updated last month
- Generating claims for zero-shot scientific fact checking☆34Mar 22, 2022Updated 4 years ago
- build and benchmark deep research☆247Mar 28, 2026Updated 5 months ago
- Code release for "SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers" [NeurIPS D&B, 2024]☆76Jan 13, 2025Updated last year