A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
☆185Jun 16, 2026Updated last month
Alternatives and similar repositories for eureka-ml-insights
Users that are interested in eureka-ml-insights are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17Feb 4, 2025Updated last year
- A mechanistic approach for understanding and detecting factual errors of large language models.☆50Jul 6, 2024Updated 2 years ago
- X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains☆49Feb 4, 2026Updated 5 months ago
- This repository contains data, code and models for contextual noncompliance.☆26Jul 18, 2024Updated 2 years ago
- ☆17Sep 23, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This repository contains papers for a comprehensive survey on accelerated generation techniques in Large Language Models (LLMs).☆11May 24, 2024Updated 2 years ago
- Python package for generating datasets to evaluate reasoning and retrieval of large language models☆25Jun 3, 2026Updated last month
- [NeurIPS'24 LanGame workshop] On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability☆42Apr 10, 2026Updated 3 months ago
- Super gorgeous, easy-to-use and convenient mind map application☆15Nov 5, 2024Updated last year
- ☆15Dec 21, 2025Updated 7 months ago
- ☆209Jun 26, 2025Updated last year
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆94May 28, 2026Updated last month
- Repository for the paper: Aligning LLMs to Ask Good Questions A Case Study in Clinical Reasoning☆18Feb 21, 2025Updated last year
- ☆23May 21, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A Sober Look at Language Model Reasoning☆92Nov 18, 2025Updated 8 months ago
- ☆123May 26, 2025Updated last year
- ☆47Mar 14, 2025Updated last year
- Official repository for the ACL 2025 Findings paper "Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal M…☆26May 12, 2026Updated 2 months ago
- Beta content for blockchain Learn modules☆16Nov 22, 2023Updated 2 years ago
- BikeSharing360 Bot Demo Apps☆32Jul 11, 2023Updated 3 years ago
- 🚀 [ICLR '25] RocketEval: Efficient Automated LLM Evaluation via Grading Checklist☆17Aug 21, 2025Updated 11 months ago
- Framework to build general purpose distributed data platform in Azure Virtual Machines to support various platforms like Hadoop, Cassandr…☆20Nov 28, 2022Updated 3 years ago
- Code for reproducing our paper: LMSOC: An Approach for Socially Sensitive Pretraining☆13Oct 22, 2021Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A simple example of VAEs with KANs☆12May 17, 2024Updated 2 years ago
- Reference implementation of CLI interface for Amplifier project☆19Updated this week
- Run safety benchmarks against AI models and view detailed reports showing how well they performed.☆128Updated this week
- ☆11Apr 21, 2023Updated 3 years ago
- Quickstart sample for using the Azure AI Studio with the SDK or CLI options - and the PromptFlow framework.☆21May 28, 2024Updated 2 years ago
- ☆20Aug 1, 2025Updated 11 months ago
- Fast search index for SPLADE sparse retrieval models implemented in Python using Numpy and Numba☆38Oct 16, 2025Updated 9 months ago
- ☆15Nov 6, 2020Updated 5 years ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,488Jun 29, 2026Updated 3 weeks ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Healthcare Blockchain Solution Accelerator☆17Dec 17, 2020Updated 5 years ago
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆25Nov 25, 2024Updated last year
- A declarative way to control LLMs.☆81Jan 26, 2026Updated 5 months ago
- BikeSharing360 Multi Container Demo☆35Apr 17, 2023Updated 3 years ago
- A framework for fine-tuning retrieval-augmented generation (RAG) systems.☆150Jun 22, 2026Updated 3 weeks ago
- This repository hosts the instructions and workshop materials for Lab 331 (Deep Research with Langchain and DeepSeek R1) for Microsoft Bu…☆26Jun 5, 2025Updated last year
- auto fine tune of models with synthetic data☆78Feb 14, 2024Updated 2 years ago