youdotcom-oss / ydc-deep-research-evalsLinks
you.com's framework for evaluating deep research systems.
☆58Updated 7 months ago
Alternatives and similar repositories for ydc-deep-research-evals
Users that are interested in ydc-deep-research-evals are comparing it to the libraries listed below
Sorting:
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆102Updated last year
- ☆43Updated last year
- Official Repo for CRMArena and CRMArena-Pro☆126Updated last month
- ☆88Updated last week
- ☆58Updated last year
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆136Updated last year
- The first dense retrieval model that can be prompted like an LM☆89Updated 7 months ago
- Verifiers for LLM Reinforcement Learning☆80Updated 8 months ago
- ☆129Updated last year
- 🚢 Data Toolkit for Sailor Language Models☆94Updated 9 months ago
- Functional Benchmarks and the Reasoning Gap☆90Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆110Updated last year
- Evaluating LLMs with CommonGen-Lite☆93Updated last year
- Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"☆111Updated last year
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆241Updated last week
- Retrieval Augmented Generation Generalized Evaluation Dataset☆59Updated 5 months ago
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆51Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆71Updated last year
- ☆35Updated 7 months ago
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆66Updated last year
- Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".☆212Updated 5 months ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆111Updated 8 months ago
- ☆124Updated 2 months ago
- Leveraging Base Language Models for Few-Shot Synthetic Data Generation☆38Updated 2 months ago
- A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.☆173Updated 2 weeks ago
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 10 months ago
- Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044☆35Updated last year
- A method for steering llms to better follow instructions☆66Updated 4 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 8 months ago