microsoft / eureka-ml-insightsLinks
A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
☆169Updated this week
Alternatives and similar repositories for eureka-ml-insights
Users that are interested in eureka-ml-insights are comparing it to the libraries listed below
Sorting:
- Source code for the collaborative reasoner research project at Meta FAIR.☆103Updated 6 months ago
- ☆80Updated 2 weeks ago
- A method for steering llms to better follow instructions☆55Updated 2 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆188Updated 7 months ago
- Code for ExploreTom☆86Updated 4 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆97Updated last week
- ☆43Updated last year
- Official Repo for CRMArena and CRMArena-Pro☆119Updated 4 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆216Updated this week
- The Granite Guardian models are designed to detect risks in prompts and responses.☆119Updated 3 weeks ago
- ☆146Updated last year
- ☆35Updated 2 months ago
- Functional Benchmarks and the Reasoning Gap☆89Updated last year
- Super basic implementation (gist-like) of RLMs with REPL environments.☆204Updated last week
- Evaluating LLMs with fewer examples☆163Updated last year
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆93Updated 5 months ago
- Train your own SOTA deductive reasoning model☆109Updated 7 months ago
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆76Updated 10 months ago
- ☆172Updated last week
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆102Updated 2 months ago
- ☆264Updated 4 months ago
- Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"☆109Updated last year
- Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"☆135Updated 2 weeks ago
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆254Updated last week
- Banishing LLM Hallucinations Requires Rethinking Generalization☆275Updated last year
- ☆142Updated last month
- code for training & evaluating Contextual Document Embedding models☆199Updated 5 months ago
- Code that accompanies the public release of the paper Lost in Conversation (https://arxiv.org/abs/2505.06120)☆176Updated 4 months ago
- [ICLR 2025] DSBench: How Far are Data Science Agents from Becoming Data Science Experts?☆78Updated 2 months ago