youdotcom-oss / ydc-deep-research-evalsLinks
you.com's framework for evaluating deep research systems.
☆45Updated 4 months ago
Alternatives and similar repositories for ydc-deep-research-evals
Users that are interested in ydc-deep-research-evals are comparing it to the libraries listed below
Sorting:
- ☆43Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆66Updated last year
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆104Updated 3 weeks ago
- Official Repo for CRMArena and CRMArena-Pro☆118Updated 3 months ago
- Just a bunch of benchmark logs for different LLMs☆118Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆50Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆109Updated 9 months ago
- Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles☆57Updated 5 months ago
- Writing Blog Posts with Generative Feedback Loops!☆50Updated last year
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆96Updated this week
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆75Updated 10 months ago
- Track the progress of LLM context utilisation☆54Updated 5 months ago
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆119Updated 2 weeks ago
- Analysis code for Neurips 2025 paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"☆52Updated 2 months ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆75Updated 11 months ago
- The first dense retrieval model that can be prompted like an LM☆89Updated 5 months ago
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).☆80Updated last year
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆111Updated 6 months ago
- ☆57Updated last year
- ☆80Updated this week
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 5 months ago
- A method for steering llms to better follow instructions☆53Updated 2 months ago
- Leveraging Base Language Models for Few-Shot Synthetic Data Generation☆35Updated 2 months ago
- A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.☆168Updated last week
- Simple examples using Argilla tools to build AI☆56Updated 10 months ago
- ☆55Updated 3 months ago
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 8 months ago
- LLM reads a paper and produce a working prototype☆57Updated 6 months ago
- ☆80Updated last year