microsoft / eureka-ml-insightsLinks
A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
☆173Updated 2 weeks ago
Alternatives and similar repositories for eureka-ml-insights
Users that are interested in eureka-ml-insights are comparing it to the libraries listed below
Sorting:
- Source code for the collaborative reasoner research project at Meta FAIR.☆112Updated 9 months ago
- A method for steering llms to better follow instructions☆74Updated 5 months ago
- ☆92Updated last month
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆190Updated 10 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆256Updated last week
- Code for ExploreTom☆89Updated 6 months ago
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆76Updated last year
- ☆42Updated last year
- Official Repo for CRMArena and CRMArena-Pro☆129Updated 2 months ago
- ☆214Updated 3 weeks ago
- Evaluating LLMs with fewer examples☆169Updated last year
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆222Updated last month
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆153Updated last year
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆277Updated this week
- Functional Benchmarks and the Reasoning Gap☆89Updated last year
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆95Updated 8 months ago
- ☆147Updated last year
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆88Updated 10 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆175Updated last year
- ☆80Updated 3 months ago
- ☆151Updated 4 months ago
- Codebase accompanying the Summary of a Haystack paper.☆80Updated last year
- The first dense retrieval model that can be prompted like an LM☆90Updated 8 months ago
- ☆136Updated 10 months ago
- The Granite Guardian models are designed to detect risks in prompts and responses.☆127Updated 3 months ago
- ☆123Updated 10 months ago
- Code that accompanies the public release of the paper Lost in Conversation (https://arxiv.org/abs/2505.06120)☆200Updated 6 months ago
- code for training & evaluating Contextual Document Embedding models☆202Updated 8 months ago
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆26Updated last month
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆234Updated 6 months ago