microsoft / eureka-ml-insightsLinks
A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
☆168Updated this week
Alternatives and similar repositories for eureka-ml-insights
Users that are interested in eureka-ml-insights are comparing it to the libraries listed below
Sorting:
- Source code for the collaborative reasoner research project at Meta FAIR.☆102Updated 5 months ago
- A method for steering llms to better follow instructions☆53Updated 2 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆96Updated this week
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆184Updated 7 months ago
- ☆80Updated this week
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆216Updated 2 months ago
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆75Updated 10 months ago
- Code for ExploreTom☆86Updated 3 months ago
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆102Updated 2 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- Official Repo for CRMArena and CRMArena-Pro☆118Updated 3 months ago
- ☆146Updated last year
- code for training & evaluating Contextual Document Embedding models☆197Updated 4 months ago
- ☆78Updated last week
- Functional Benchmarks and the Reasoning Gap☆89Updated last year
- Evaluating LLMs with fewer examples☆161Updated last year
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆172Updated 8 months ago
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆24Updated 3 weeks ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆77Updated 6 months ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆142Updated last year
- ☆33Updated last month
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- ☆136Updated this week
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆93Updated 4 months ago
- ☆43Updated last year
- ☆128Updated last year
- Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.☆243Updated 2 months ago
- ☆218Updated 7 months ago
- Repository for the paper Stream of Search: Learning to Search in Language☆151Updated 8 months ago
- ☆142Updated last month