Su-Sea / ydc-deep-research-evalsLinks
you.com's framework for evaluating deep research systems.
☆27Updated 3 months ago
Alternatives and similar repositories for ydc-deep-research-evals
Users that are interested in ydc-deep-research-evals are comparing it to the libraries listed below
Sorting:
- Using open source LLMs to build synthetic datasets for direct preference optimization☆65Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆33Updated 3 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆102Updated last year
- Official Repo for CRMArena and CRMArena-Pro☆104Updated last month
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆60Updated 8 months ago
- ☆41Updated last year
- ☆57Updated 10 months ago
- Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles☆54Updated 3 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated 10 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆105Updated 8 months ago
- Leveraging Base Language Models for Few-Shot Synthetic Data Generation☆33Updated 2 weeks ago
- Just a bunch of benchmark logs for different LLMs☆119Updated last year
- ☆47Updated last year
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆82Updated this week
- A method for steering llms to better follow instructions☆49Updated last week
- ☆76Updated last week
- Evaluating LLMs with CommonGen-Lite☆90Updated last year
- The first dense retrieval model that can be prompted like an LM☆83Updated 3 months ago
- Code and Dataset for Learning to Solve Complex Tasks by Talking to Agents☆24Updated 3 years ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆63Updated this week
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated 11 months ago
- Python library to use Pleias-RAG models☆61Updated 3 months ago
- human_detectors hosts the data released from the paper "People who frequently use ChatGPT for writing tasks are accurate and robust detec…☆40Updated 3 months ago
- Explore the use of DSPy for extracting features from PDFs 🔎☆46Updated last year
- Retrieval Augmented Generation Generalized Evaluation Dataset☆54Updated last month
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 6 months ago
- ☆19Updated last year
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).☆80Updated last year
- Source code for the collaborative reasoner research project at Meta FAIR.☆100Updated 3 months ago