AkariAsai / OpenScholar_ExpertEvalLinks
This repository contains expert evaluation interface and data evaluation script for the OpenScholar project.
☆29Updated last year
Alternatives and similar repositories for OpenScholar_ExpertEval
Users that are interested in OpenScholar_ExpertEval are comparing it to the libraries listed below
Sorting:
- Analysis code for Neurips 2025 paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"☆56Updated 5 months ago
- This repository contains ScholarQABench data and evaluation pipeline.☆94Updated 5 months ago
- ☆42Updated 8 months ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆112Updated 9 months ago
- ☆67Updated 10 months ago
- The official implementation of the paper "Chain-of-Tools: Utilizing Massive Unseen Tools in the CoT Reasoning of Frozen Language Models".☆87Updated 10 months ago
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 11 months ago
- ☆55Updated last year
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆102Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆80Updated last year
- ☆61Updated 7 months ago
- Jina VDR is a multilingual, multi-domain benchmark for visual document retrieval☆38Updated 5 months ago
- ☆54Updated 2 weeks ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆260Updated last week
- ☆20Updated 9 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆61Updated last year
- ☆40Updated 8 months ago
- SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning☆92Updated last month
- ☆95Updated last week
- ☆24Updated 10 months ago
- [ICLR'25] ApolloMoE: Efficiently Democratizing Medical LLMs for 50 Languages via a Mixture of Language Family Experts☆52Updated last year
- Leveraging Base Language Models for Few-Shot Synthetic Data Generation☆40Updated 3 months ago
- ☆59Updated last year
- ☆39Updated last year
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆76Updated last year
- Verifiers for LLM Reinforcement Learning☆80Updated 9 months ago
- Codebase from our first release.☆41Updated 3 weeks ago
- Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.☆47Updated 10 months ago
- The first dense retrieval model that can be prompted like an LM☆90Updated 8 months ago
- Source code for our paper: "SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals".☆69Updated last year