microsoft / eureka-ml-insightsLinks
A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
☆156Updated this week
Alternatives and similar repositories for eureka-ml-insights
Users that are interested in eureka-ml-insights are comparing it to the libraries listed below
Sorting:
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆205Updated 3 weeks ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆91Updated 2 months ago
- Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"☆127Updated 10 months ago
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆112Updated 9 months ago
- ☆61Updated 3 weeks ago
- A method for steering llms to better follow instructions☆46Updated 3 weeks ago
- ☆134Updated 2 months ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆124Updated last year
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆173Updated 3 months ago
- LOFT: A 1 Million+ Token Long-Context Benchmark☆202Updated last week
- PyTorch library for Active Fine-Tuning☆80Updated 4 months ago
- Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".☆170Updated 3 weeks ago
- Code accompanying "How I learned to start worrying about prompt formatting".☆105Updated 2 weeks ago
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆137Updated 7 months ago
- Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"☆106Updated 8 months ago
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆206Updated this week
- ☆123Updated 8 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆226Updated 7 months ago
- Codebase accompanying the Summary of a Haystack paper.☆78Updated 9 months ago
- ☆69Updated 4 months ago
- Functional Benchmarks and the Reasoning Gap☆87Updated 8 months ago
- Official Repo for CRMArena and CRMArena-Pro☆92Updated last week
- ☆39Updated 11 months ago
- Complex Function Calling Benchmark.☆114Updated 5 months ago
- ☆92Updated 3 weeks ago
- (ACL 2025 Main) Code for MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents https://www.arxiv.org/pdf/2503.019…☆120Updated this week
- Repository for the paper Stream of Search: Learning to Search in Language☆148Updated 4 months ago
- ☆27Updated last week
- A framework for fine-tuning retrieval-augmented generation (RAG) systems.☆112Updated this week
- Code that accompanies the public release of the paper Lost in Conversation (https://arxiv.org/abs/2505.06120)☆130Updated last week