perplexityai / search_evalsLinks
Batteries-included eval framework for search APIs
☆177Updated last week
Alternatives and similar repositories for search_evals
Users that are interested in search_evals are comparing it to the libraries listed below
Sorting:
- Training setup for Langchain's Open Deep Research☆73Updated 3 months ago
- Official Repo for CRMArena and CRMArena-Pro☆126Updated last month
- Streamline on-policy/off-policy distillation workflows in a few lines of code☆81Updated this week
- ☆40Updated last year
- ☆24Updated 10 months ago
- Lightweight Non-Parametric Embedding Fine-Tuning☆38Updated 3 months ago
- ☆53Updated 10 months ago
- ☆81Updated last month
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated last year
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆115Updated 8 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆246Updated this week
- Routing on Random Forest (RoRF)☆235Updated last year
- XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.☆174Updated 7 months ago
- ☆62Updated last year
- Data recipes and robust infrastructure for training AI agents☆68Updated this week
- ☆59Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆80Updated last year
- The first dense retrieval model that can be prompted like an LM☆89Updated 7 months ago
- Complex Function Calling Benchmark.☆159Updated 11 months ago
- Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles☆61Updated 7 months ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆111Updated 8 months ago
- ☆92Updated last month
- ☆68Updated 7 months ago
- Writing Blog Posts with Generative Feedback Loops!☆50Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated 2 months ago
- ☆63Updated 5 months ago
- ☆235Updated 3 weeks ago
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆102Updated 4 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 8 months ago
- j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.☆99Updated 5 months ago