microsoft / eureka-ml-insightsLinks
A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
☆171Updated last week
Alternatives and similar repositories for eureka-ml-insights
Users that are interested in eureka-ml-insights are comparing it to the libraries listed below
Sorting:
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆100Updated last week
- A method for steering llms to better follow instructions☆58Updated 3 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆189Updated 8 months ago
- ☆81Updated last week
- Source code for the collaborative reasoner research project at Meta FAIR.☆105Updated 7 months ago
- Official Repo for CRMArena and CRMArena-Pro☆125Updated last week
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆76Updated 11 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆218Updated 2 weeks ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- Functional Benchmarks and the Reasoning Gap☆89Updated last year
- ☆43Updated last year
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆150Updated last year
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆102Updated 3 months ago
- ☆135Updated 7 months ago
- Evaluating LLMs with fewer examples☆167Updated last year
- Code for ExploreTom☆87Updated 4 months ago
- ☆79Updated last month
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆173Updated 10 months ago
- Train your own SOTA deductive reasoning model☆107Updated 8 months ago
- ☆35Updated 2 months ago
- ☆143Updated 2 months ago
- accompanying material for sleep-time compute paper☆117Updated 6 months ago
- Repository for the paper Stream of Search: Learning to Search in Language☆151Updated 9 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆109Updated 11 months ago
- ☆88Updated last week
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆94Updated 6 months ago
- Leveraging Base Language Models for Few-Shot Synthetic Data Generation☆38Updated last month
- Super basic implementation (gist-like) of RLMs with REPL environments.☆248Updated last month
- ☆124Updated 8 months ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆82Updated 8 months ago