A principled reduction of six benchmarks from the Open LLM Leaderboard to a single sparse benchmark
☆12Oct 26, 2026Updated last week
Alternatives and similar repositories for metabench
Users that are interested in metabench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A revised version of Wuggy, implemented as a Python library☆31Jul 18, 2026Updated 3 months ago
- Learning programs with the Exploration-Compression algorithm☆10May 17, 2018Updated 8 years ago
- [ACL 2026] A Multi-Dimensional Constraint Framework for Evaluating and Improving Instruction Following in Large Language Models☆23Jul 10, 2026Updated 3 months ago
- An SRL-based approach to factuality estimation for text summarization☆10May 24, 2023Updated 3 years ago
- ☆16Aug 15, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A simple model for predicting soccer outcomes☆11Jul 12, 2024Updated 2 years ago
- A package dedicated for running benchmark agreement testing☆19Sep 18, 2025Updated last year
- Search for pages on Wikipedia and add links☆20Dec 3, 2025Updated 10 months ago
- This is an implementation of the paper "Are We Done with Object-Centric Learning?"☆14Oct 19, 2026Updated 2 weeks ago
- A benchmark of programming tasks for LLMs that supports almost any programming language.☆13Jun 30, 2025Updated last year
- Read in a 'Praat' 'TextGrid' File☆17Oct 28, 2025Updated last year
- Source code for the paper "Do Deep Neural Network Solutions form a Star Domain?"☆11May 26, 2024Updated 2 years ago
- ☆14Jul 13, 2025Updated last year
- ☆10Sep 18, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Find informative examples to efficiently (human)-evaluate NLG models.☆17Apr 22, 2026Updated 6 months ago
- Bayesian IRT submodule for GIRTH☆19Nov 11, 2021Updated 4 years ago
- Community-curated record of math problems solved by AI - significance rankings, verification labels, CC BY 4.0 dataset☆30Oct 15, 2026Updated 2 weeks ago
- An implementation of GRPO for Unsloth's VLMs training☆84Aug 7, 2025Updated last year
- About We proposed to build a low cost SLAM system toexplore and search for the target in unknown environment.☆10Jul 2, 2024Updated 2 years ago
- ♠️TrucoBench: Qual é o melhor LLM no truco? Resultados, análises e insights estratégicos.☆19Feb 24, 2025Updated last year
- Repo for the Tutorials of Day1-Day2 of the Nordic Probabilistic AI School 2023☆17Jun 13, 2023Updated 3 years ago
- ☆12Oct 4, 2023Updated 3 years ago
- Speaker Identity for Topic Segmentation (SITS)☆13Dec 14, 2014Updated 11 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official Code Repositiry for "RaDeR: Reasoning-aware Dense Retrieval Models" accepted at Main Conference EMNLP 2025☆18Jun 23, 2025Updated last year
- Enhanced Unsupervised Object Discoveries through Exhaustive Self-Supervised Transformers☆16Jun 25, 2024Updated 2 years ago
- Code for the paper "Studying Large Language Model Behaviors Under Context-Memory Conflicts With Real Documentss"☆14Oct 8, 2024Updated 2 years ago
- ☆30Aug 26, 2026Updated 2 months ago
- ☆17Jul 4, 2025Updated last year
- [CVPR 2026] Official PyTorch implementation of SelVA "Hear What Matters! Text-conditioned Selective Video-to-Audio Generation"☆18Mar 27, 2026Updated 7 months ago
- ☆18Oct 9, 2026Updated 3 weeks ago
- Expand -> Retrieve -> Rerank - simple method with strong results on BRIGHT benchmark☆22Aug 22, 2025Updated last year
- SSH tunneling daemon☆22Jan 19, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆19Jul 18, 2024Updated 2 years ago
- LaTeX template for my PhD thesis at the University of Tuebingen☆15Feb 25, 2023Updated 3 years ago
- Official code for the paper "Compositional Generalization Requires Linear, Orthogonal Representations in Vision Embedding Models"☆24Mar 7, 2026Updated 7 months ago
- ☆15Apr 13, 2026Updated 6 months ago
- Code used to run the platform for the LLM CTF colocated with SaTML 2024☆31Mar 20, 2024Updated 2 years ago
- Official repo for Customized but Compromised: Assessing Prompt Injection Risks in User-Designed GPTs☆34Nov 22, 2023Updated 2 years ago
- ☆15Aug 2, 2024Updated 2 years ago