AkariAsai / ScholarQABenchLinks
This repository contains ScholarQABench data and evaluation pipeline.
☆85Updated 3 months ago
Alternatives and similar repositories for ScholarQABench
Users that are interested in ScholarQABench are comparing it to the libraries listed below
Sorting:
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆101Updated 11 months ago
- Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty☆87Updated last year
- Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.☆44Updated 7 months ago
- Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".☆206Updated 4 months ago
- 🚢 Data Toolkit for Sailor Language Models☆94Updated 8 months ago
- [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery☆107Updated 2 months ago
- ☆74Updated last year
- ☆129Updated last year
- Code release for "SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers" [NeurIPS D&B, 2024]☆69Updated 10 months ago
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆43Updated 8 months ago
- This is the code repo for our paper "Enhancing Knowledge Integration and Utilization of Large Language Models via Constructivist Cognitio…☆109Updated last month
- ☆156Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆42Updated last year
- Code/data for MARG (multi-agent review generation)☆58Updated last month
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆135Updated last year
- ☆48Updated last year
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆149Updated last year
- Pretraining Efficiently on S2ORC!☆172Updated last year
- SciGLM: Training Scientific Language Models with Self-Reflective Instruction Annotation and Tuning (NeurIPS D&B Track 2024)☆83Updated last year
- [Preprint] Learning to Filter Context for Retrieval-Augmented Generaton☆197Updated last year
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆99Updated 2 years ago
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆107Updated 2 weeks ago
- A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…☆128Updated last year
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆218Updated 2 weeks ago
- A Survey of Attributions for Large Language Models☆218Updated last year
- Benchmarking LLMs with Challenging Tasks from Real Users☆244Updated last year
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- Code accompanying "How I learned to start worrying about prompt formatting".☆110Updated 5 months ago
- ☆51Updated this week