AkariAsai / ScholarQABenchLinks
This repository contains ScholarQABench data and evaluation pipeline.
☆91Updated 4 months ago
Alternatives and similar repositories for ScholarQABench
Users that are interested in ScholarQABench are comparing it to the libraries listed below
Sorting:
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆102Updated last year
- Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.☆47Updated 9 months ago
- Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty☆92Updated last year
- [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery☆116Updated 4 months ago
- Code/data for MARG (multi-agent review generation)☆59Updated 2 months ago
- ☆75Updated last year
- ☆51Updated last year
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆42Updated last year
- This is the code repo for our paper "Enhancing Knowledge Integration and Utilization of Large Language Models via Constructivist Cognitio…☆112Updated 2 months ago
- Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".☆212Updated 6 months ago
- Codebase accompanying the Summary of a Haystack paper.☆80Updated last year
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆229Updated 7 months ago
- 🚢 Data Toolkit for Sailor Language Models☆94Updated 10 months ago
- ☆129Updated last year
- Pretraining Efficiently on S2ORC!☆177Updated last year
- Discovering Data-driven Hypotheses in the Wild☆123Updated 6 months ago
- Code accompanying "How I learned to start worrying about prompt formatting".☆113Updated 6 months ago
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆149Updated last year
- ☆163Updated 2 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆136Updated last year
- A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…☆128Updated last year
- A Survey of Attributions for Large Language Models☆221Updated last year
- Code release for "SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers" [NeurIPS D&B, 2024]☆71Updated 11 months ago
- Code and Data for "Language Modeling with Editable External Knowledge"☆36Updated last year
- SciGLM: Training Scientific Language Models with Self-Reflective Instruction Annotation and Tuning (NeurIPS D&B Track 2024)☆85Updated last year
- [NAACL'24] Dataset, code and models for "TableLlama: Towards Open Large Generalist Models for Tables".☆132Updated last year
- Benchmarking LLMs with Challenging Tasks from Real Users☆246Updated last year
- ☆242Updated last year
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆114Updated 3 weeks ago
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆145Updated last year