AkariAsai / ScholarQABenchLinks
This repository contains ScholarQABench data and evaluation pipeline.
☆85Updated 2 months ago
Alternatives and similar repositories for ScholarQABench
Users that are interested in ScholarQABench are comparing it to the libraries listed below
Sorting:
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆98Updated 10 months ago
- Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty☆85Updated last year
- Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".☆205Updated 4 months ago
- Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.☆43Updated 7 months ago
- This is the code repo for our paper "Enhancing Knowledge Integration and Utilization of Large Language Models via Constructivist Cognitio…☆108Updated 2 weeks ago
- 🚢 Data Toolkit for Sailor Language Models☆94Updated 8 months ago
- ☆74Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery☆106Updated 2 months ago
- Pretraining Efficiently on S2ORC!☆170Updated last year
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆148Updated 11 months ago
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆43Updated 8 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆135Updated last year
- Discovering Data-driven Hypotheses in the Wild☆114Updated 4 months ago
- ☆155Updated last year
- Code and Data for "Language Modeling with Editable External Knowledge"☆36Updated last year
- Code release for "SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers" [NeurIPS D&B, 2024]☆64Updated 9 months ago
- Python package for serving a local search engine. One command to download and serve a datastore---that's it 😎.☆23Updated 4 months ago
- A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…☆127Updated last year
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆99Updated 2 years ago
- Code accompanying "How I learned to start worrying about prompt formatting".☆112Updated 4 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆216Updated this week
- [ACL 2025 Main] Official Repository for "Evaluating Language Models as Synthetic Data Generators"☆39Updated 10 months ago
- ☆37Updated 9 months ago
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆42Updated 11 months ago
- SciGLM: Training Scientific Language Models with Self-Reflective Instruction Annotation and Tuning (NeurIPS D&B Track 2024)☆83Updated last year
- ☆128Updated last year
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆103Updated this week
- [NAACL'24] Dataset, code and models for "TableLlama: Towards Open Large Generalist Models for Tables".☆131Updated last year
- [ICLR'25] "Attention in Large Language Models Yields Efficient Zero-Shot Re-Rankers"☆36Updated 6 months ago