Alternatives and similar repositories for ScholarQABench

Users that are interested in ScholarQABench are comparing it to the libraries listed below

• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆90Updated 7 months ago
• EagleW / Scientific-Inspiration-Machines-Optimized-for-Novelty
  Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty
  ☆81Updated last year
• OSU-NLP-Group / ScienceAgentBench
  [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
  ☆91Updated last month
• allenai / marg-reviewer
  Code/data for MARG (multi-agent review generation)
  ☆44Updated 8 months ago
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆40Updated 3 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated 9 months ago
• xxxiaol / QRData
  Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data
  ☆41Updated 4 months ago
• facebookresearch / ReasonIR
  Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".
  ☆176Updated 3 weeks ago
• Ayanami0730 / deep_research_bench
  DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents
  ☆190Updated 3 weeks ago
• SALT-NLP / demonstrated-feedback
  ☆124Updated 9 months ago
• jakespringer / echo-embeddings
  ☆151Updated last year
• lilakk / BooookScore
  A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…
  ☆123Updated 9 months ago
• abhika-m / FAVA
  ☆72Updated last year
• OpenMatch / ActiveRAG
  This is the code repo for our paper "Autonomously Knowledge Assimilation and Accommodation through Retrieval-Augmented Agents".
  ☆107Updated 8 months ago
• suzgunmirac / dynamic-cheatsheet
  Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory
  ☆66Updated last month
• sail-sg / sailcraft
  🚢 Data Toolkit for Sailor Language Models
  ☆93Updated 4 months ago
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆47Updated 5 months ago
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆106Updated last month
• ChicagoHAI / hypothesis-generation
  This is the official repository for HypoGeniC (Hypothesis Generation in Context) and HypoRefine, which are automated, data-driven tools t…
  ☆76Updated this week
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆145Updated 8 months ago
• ZonglinY / MOOSE
  [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …
  ☆42Updated 8 months ago
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 5 months ago
• belindal / ERASE
  Code and Data for "Language Modeling with Editable External Knowledge"
  ☆34Updated last year
• THUDM / SciGLM
  SciGLM: Training Scientific Language Models with Self-Reflective Instruction Annotation and Tuning (NeurIPS D&B Track 2024)
  ☆79Updated last year
• AkariAsai / OpenScholar_ExpertEval
  This repository contains expert evaluation interface and data evaluation script for the OpenScholar project.
  ☆25Updated 7 months ago
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆138Updated 8 months ago
• allenai / peS2o
  Pretraining Efficiently on S2ORC!
  ☆164Updated 8 months ago
• SALT-NLP / collaborative-gym
  Framework and toolkits for building and evaluating collaborative agents that can work together with humans.
  ☆88Updated 3 months ago
• neulab / data-agora
  [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"
  ☆33Updated 7 months ago
• xlang-ai / BRIGHT
  BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆149Updated last month