BenchBench is a Python package to evaluate multi-task benchmarks.
☆24Oct 12, 2025Updated 10 months ago
Alternatives and similar repositories for benchbench
Users that are interested in benchbench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Achieve error-rate fairness between societal groups for any score-based classifier.☆19Aug 21, 2025Updated last year
- Wrap around any model to output differentially private prediction sets with finite sample validity on any dataset.☆18Mar 3, 2024Updated 2 years ago
- ☆34Jan 13, 2022Updated 4 years ago
- [EMNLP 2024] A Peek into Token Bias: Large Language Models Are Not Yet Genuine Reasoners☆28Dec 11, 2024Updated last year
- PyTorch-based library for various kinds of representational-similarity analysis☆26Jun 7, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Training a model without a dataset for natural language inference (NLI)☆25Aug 3, 2020Updated 6 years ago
- Notebooks for managing NeurIPS 2014 and analysing the NeurIPS experiment.☆13May 22, 2024Updated 2 years ago
- Zero dependency Clojure Prometheus Client☆12Apr 7, 2022Updated 4 years ago
- Code and results accompanying our paper titled RLSbench: Domain Adaptation under Relaxed Label Shift☆35Jul 19, 2023Updated 3 years ago
- Experiments for efforts to train a new and improved t5☆76Apr 15, 2024Updated 2 years ago
- TensorFlow implementation of FAIR's InferSent (Supervised Learning of Universal Sentence Representations from Natural Language Inference …☆14Aug 6, 2018Updated 8 years ago
- ☆16Oct 16, 2023Updated 2 years ago
- Code and data for the ACM CIKM 2022 paper "Rank List Sensitivity of Recommender Systems to Interaction Perturbations"☆10Aug 16, 2022Updated 4 years ago
- SVM's for Julia☆40Jul 26, 2016Updated 10 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Implements PyTorch model which updates SPD weights on Riemannian Manifold. Based on Huang, Z., & Van Gool, L. (2016). A Riemannian Netwo…☆12Mar 8, 2019Updated 7 years ago
- pytest helps for compare images and regression☆13Dec 31, 2024Updated last year
- Dimensionality reduction on manifold of SPD matrices, based on pymanopt implementation☆11Apr 18, 2023Updated 3 years ago
- ☆13Jul 8, 2023Updated 3 years ago
- Utility for OpenAI GPT Functions☆14Jun 25, 2023Updated 3 years ago
- code related to Shirvalkar et al. 2023 - Nature Neuroscience☆10May 22, 2023Updated 3 years ago
- Exploring item combinations with a bar chart☆10Apr 17, 2021Updated 5 years ago
- Models for Nature Language Inference (Tensorflow Version), including 'A Decomposable Attention Model for Natural Language Inference', ...…☆18Apr 21, 2018Updated 8 years ago
- ☆12Sep 26, 2019Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Efficient 3D interactive segmentation with the nnU-Net☆12Jun 15, 2022Updated 4 years ago
- In this paper, we show that the performance of a learnt generative model is closely related to the model's ability to accurately represen…☆41Mar 26, 2021Updated 5 years ago
- Spell and pronounce words with a neural network☆10Feb 13, 2017Updated 9 years ago
- Ruby gem used to load, validate, and parse European Data Format files. Used for batch testing EDFs for errors.☆14Mar 1, 2019Updated 7 years ago
- [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…☆30Jul 24, 2025Updated last year
- ☆32Jan 28, 2024Updated 2 years ago
- Accelerating Transfer Learning with Robust Neural Nets☆11Oct 2, 2020Updated 5 years ago
- Extract your SlidesLive presentation.☆15Apr 19, 2024Updated 2 years ago
- We introduce XBrainLab, an open-source user-friendly software, for accelerated interpretation of neural patterns from EEG data based on c…☆14Dec 5, 2025Updated 8 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆23Mar 6, 2026Updated 5 months ago
- Interactive notebook introducing the matrix exponential and matrix Lie groups, from the Quantum Formalism lecture series.☆12Apr 17, 2025Updated last year
- Project for SNARE benchmark☆11Jun 5, 2024Updated 2 years ago
- A GitHub action to run clang-tidy and annotate failures☆14Jul 12, 2023Updated 3 years ago
- ROCK Framework for Commonsense Causality Reasoning (CCR)☆10Jun 28, 2023Updated 3 years ago
- Implementation of FixMatch in PyTorch and experimentations☆12Aug 9, 2020Updated 6 years ago
- Code for the ICML 2021 paper "Sharing Less is More: Lifelong Learning in Deep Networks with Selective Layer Transfer"☆12Aug 17, 2021Updated 5 years ago