microsoft / eureka-ml-insightsLinks
A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
☆163Updated this week
Alternatives and similar repositories for eureka-ml-insights
Users that are interested in eureka-ml-insights are comparing it to the libraries listed below
Sorting:
- Source code for the collaborative reasoner research project at Meta FAIR.☆95Updated 3 months ago
- A method for steering llms to better follow instructions☆47Updated last week
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆173Updated 4 months ago
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆71Updated 7 months ago
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆211Updated this week
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆73Updated 2 weeks ago
- ☆69Updated last month
- Code for ExploreTom☆84Updated 3 weeks ago
- Train your own SOTA deductive reasoning model☆99Updated 4 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆206Updated last month
- Functional Benchmarks and the Reasoning Gap☆88Updated 9 months ago
- ☆145Updated 11 months ago
- Evaluating LLMs with fewer examples☆160Updated last year
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆128Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆79Updated 9 months ago
- Official Repo for CRMArena and CRMArena-Pro☆101Updated 3 weeks ago
- ☆40Updated last year
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆23Updated 3 months ago
- ☆134Updated 3 months ago
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆91Updated 2 months ago
- ☆118Updated 10 months ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆223Updated 7 months ago
- (ACL 2025 Main) Code for MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents https://www.arxiv.org/pdf/2503.019…☆132Updated this week
- code for training & evaluating Contextual Document Embedding models☆194Updated 2 months ago
- ☆117Updated 4 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated 10 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆173Updated 6 months ago
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆113Updated 10 months ago
- ☆129Updated 3 months ago
- ☆33Updated 2 months ago