BenchBench is a Python package to evaluate multi-task benchmarks.
☆19Oct 12, 2025Updated 7 months ago
Alternatives and similar repositories for benchbench
Users that are interested in benchbench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Achieve error-rate fairness between societal groups for any score-based classifier.☆19Aug 21, 2025Updated 9 months ago
- Code to reproduce the paper "Do causal predictors generalize better to new domains?"☆16Feb 7, 2025Updated last year
- A reliable leaderboard algorithm for machine learning competitions☆17May 19, 2015Updated 11 years ago
- Package for typesetting a book into PDF and HTML using pandoc and a bunch of other tools☆15Jul 21, 2020Updated 5 years ago
- This is the code of our work CISS Certified Robustness Against Natural Language Attacks by Causal Intervention published on ICML 2022☆11Dec 6, 2022Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- This is the way: designing and compiling LEPISZCZE, a comprehensive NLP benchmark for Polish☆14Updated this week
- Test-time-training on nearest neighbors for large language models☆50Apr 18, 2024Updated 2 years ago
- Training a model without a dataset for natural language inference (NLI)☆25Aug 3, 2020Updated 5 years ago
- Notebooks for managing NeurIPS 2014 and analysing the NeurIPS experiment.☆13May 22, 2024Updated 2 years ago
- Code and results accompanying our paper titled RLSbench: Domain Adaptation under Relaxed Label Shift☆35Jul 19, 2023Updated 2 years ago
- An easy way to get latex snippets into Keynote☆22Dec 11, 2016Updated 9 years ago
- TensorFlow implementation of FAIR's InferSent (Supervised Learning of Universal Sentence Representations from Natural Language Inference …☆14Aug 6, 2018Updated 7 years ago
- Benchmarking STT service TTFB and semantic WER for real-time AI applications☆67Updated this week
- ☆16Oct 16, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Implements PyTorch model which updates SPD weights on Riemannian Manifold. Based on Huang, Z., & Van Gool, L. (2016). A Riemannian Netwo…☆12Mar 8, 2019Updated 7 years ago
- Diffusion for EEG☆11Jan 2, 2023Updated 3 years ago
- SVM's for Julia☆40Jul 26, 2016Updated 9 years ago
- Multi-Task Speech classification of accent and gender of an english speaker on Mozilla's common voice dataset☆28May 30, 2025Updated 11 months ago
- ☆12Jul 8, 2023Updated 2 years ago
- A random forest classifier to predict the age-group and gender of a speaker from voice measurements.☆18Apr 30, 2019Updated 7 years ago
- Utility for OpenAI GPT Functions☆14Jun 25, 2023Updated 2 years ago
- This is the project page for paper `CAM Back Again: Large Kernel CNNs from a Weakly Supervised Object Localization Perspective`, in CVPR2…☆13Mar 19, 2024Updated 2 years ago
- Data Benchmarking☆25May 24, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- PyTorch implementation for "Generative Modeling on Manifolds Through Mixture of Riemannian Diffusion Processes" (ICML 2024).☆13Jul 21, 2024Updated last year
- [EMNLP 2024] A Peek into Token Bias: Large Language Models Are Not Yet Genuine Reasoners☆27Dec 11, 2024Updated last year
- code related to Shirvalkar et al. 2023 - Nature Neuroscience☆10May 22, 2023Updated 2 years ago
- Exploring item combinations with a bar chart☆10Apr 17, 2021Updated 5 years ago
- ☆10Jun 13, 2021Updated 4 years ago
- Create generated datasets and train robust classifiers☆36Sep 1, 2023Updated 2 years ago
- ☆24Oct 6, 2025Updated 7 months ago
- [ICML2023] Instant Soup Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models. Ajay Jaiswal, Shiwei Liu, Ti…☆11Nov 28, 2023Updated 2 years ago
- Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)☆17Oct 11, 2021Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- In this paper, we show that the performance of a learnt generative model is closely related to the model's ability to accurately represen…☆41Mar 26, 2021Updated 5 years ago
- ☆12Sep 26, 2019Updated 6 years ago
- 11th Solution of Kaggle TalkingData AdTracking Fraud Detection Challenge☆10May 10, 2018Updated 8 years ago
- Ruby gem used to load, validate, and parse European Data Format files. Used for batch testing EDFs for errors.☆14Mar 1, 2019Updated 7 years ago
- Script to perform statistical significance test between ASR hypotheses.☆23Aug 13, 2017Updated 8 years ago
- ☆32Jan 28, 2024Updated 2 years ago
- Code helper for BEETL competition☆12Sep 11, 2021Updated 4 years ago