AkariAsai / ScholarQABenchLinks
This repository contains ScholarQABench data and evaluation pipeline.
☆78Updated last week
Alternatives and similar repositories for ScholarQABench
Users that are interested in ScholarQABench are comparing it to the libraries listed below
Sorting:
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆94Updated 8 months ago
- Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty☆84Updated last year
- 🚢 Data Toolkit for Sailor Language Models☆94Updated 6 months ago
- ☆74Updated last year
- Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".☆191Updated 2 months ago
- [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery☆97Updated 2 months ago
- ☆126Updated 10 months ago
- Discovering Data-driven Hypotheses in the Wild☆104Updated 2 months ago
- ☆49Updated last year
- This is the code repo for our paper "Autonomously Knowledge Assimilation and Accommodation through Retrieval-Augmented Agents".☆107Updated 10 months ago
- Code/data for MARG (multi-agent review generation)☆49Updated 9 months ago
- ☆154Updated last year
- A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…☆124Updated 10 months ago
- Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.☆40Updated 5 months ago
- [ACL 2025 Main] Official Repository for "Evaluating Language Models as Synthetic Data Generators"☆38Updated 8 months ago
- Pretraining Efficiently on S2ORC!☆165Updated 10 months ago
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆146Updated 9 months ago
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆93Updated 4 months ago
- SciGLM: Training Scientific Language Models with Self-Reflective Instruction Annotation and Tuning (NeurIPS D&B Track 2024)☆81Updated last year
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆213Updated 3 weeks ago
- [ICLR 2025] BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval☆157Updated 3 months ago
- Official implementation of ACL 2025 Findings paper "Autonomous Data Selection with Zero-shot Generative Classifiers for Mathematical Text…☆84Updated last month
- Code and Data for "Language Modeling with Editable External Knowledge"☆34Updated last year
- Code accompanying "How I learned to start worrying about prompt formatting".☆109Updated 2 months ago
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆37Updated 7 months ago
- Test-time compute in information retrieval☆41Updated last month
- This is the official repository for HypoGeniC (Hypothesis Generation in Context) and HypoRefine, which are automated, data-driven tools t…☆82Updated last week
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆97Updated last year
- ☆62Updated last month
- Benchmarking LLMs with Challenging Tasks from Real Users☆237Updated 9 months ago