AkariAsai / ScholarQABenchLinks
This repository contains ScholarQABench data and evaluation pipeline.
☆88Updated 3 months ago
Alternatives and similar repositories for ScholarQABench
Users that are interested in ScholarQABench are comparing it to the libraries listed below
Sorting:
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆101Updated last year
- Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty☆89Updated last year
- ☆75Updated last year
- Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.☆44Updated 8 months ago
- 🚢 Data Toolkit for Sailor Language Models☆94Updated 9 months ago
- [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery☆111Updated 3 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- Code/data for MARG (multi-agent review generation)☆59Updated 2 months ago
- ☆50Updated last year
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆135Updated last year
- Code release for "SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers" [NeurIPS D&B, 2024]☆70Updated 10 months ago
- Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".☆209Updated 5 months ago
- This is the code repo for our paper "Enhancing Knowledge Integration and Utilization of Large Language Models via Constructivist Cognitio…☆111Updated last month
- ☆129Updated last year
- Code accompanying "How I learned to start worrying about prompt formatting".☆112Updated 5 months ago
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆44Updated 9 months ago
- ☆157Updated last month
- Discovering Data-driven Hypotheses in the Wild☆119Updated 5 months ago
- Code and Data for "Language Modeling with Editable External Knowledge"☆36Updated last year
- Pretraining Efficiently on S2ORC!☆174Updated last year
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆112Updated this week
- Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)☆48Updated 10 months ago
- ☆157Updated last year
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆99Updated 2 years ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆220Updated last month
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆149Updated last year
- [Preprint] Learning to Filter Context for Retrieval-Augmented Generaton☆197Updated last year
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆215Updated last year
- This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"☆206Updated 11 months ago
- A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…☆128Updated last year