Comprehensive LLM evaluation framework: GPQA Diamond to Chatbot Arena. Tests all major models equally, easily extensible.
☆17Aug 22, 2024Updated last year
Alternatives and similar repositories for BenchmarkAggregator
Users that are interested in BenchmarkAggregator are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆10Feb 20, 2023Updated 3 years ago
- Generate a sound set using Amazon Polly☆10Jul 25, 2024Updated 2 years ago
- GOPHI: an AMR-to-English Verbalizer☆12Feb 5, 2020Updated 6 years ago
- ☆11Jun 14, 2019Updated 7 years ago
- Logical inference system based on event semantics and degree semantics in formal semantics☆10Jan 22, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Python command-line tool for interacting with AI models through the OpenRouter API/Cloudflare AI Gateway, or local self-hosted Ollama. O…☆21Dec 28, 2025Updated 7 months ago
- ☆10Jun 11, 2019Updated 7 years ago
- No dups, no doubts☆14Jun 1, 2020Updated 6 years ago
- Example usage of BIDSIO for input + output for use with the ISLES 2022 Challenge☆13Sep 26, 2022Updated 3 years ago
- Free e-books, built from markdown☆13Jul 15, 2024Updated 2 years ago
- TPTP python library and benchmarking service☆13Jul 20, 2026Updated 3 weeks ago
- The original sources of MS-DOS 1.25 and 2.0, for reference purposes☆16Apr 27, 2024Updated 2 years ago
- PANiC - PAraphrasing Noun-Compounds☆15Apr 6, 2018Updated 8 years ago
- 使用verilog实现流水线 FFT☆16Jul 1, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Data and all☆14Sep 30, 2019Updated 6 years ago
- Python library providing a simple, fully supervised sentence embedding technique for textual adversarial attacks.☆13Dec 13, 2023Updated 2 years ago
- Built an end-to-end AI system which features a deep learning algorithm that integrates into a clinical-grade viewer and automatically mea…☆14Aug 8, 2020Updated 6 years ago
- The chaos Operating System☆18Mar 13, 2025Updated last year
- [ACL'24 Oral] Code for 'Rewriting the Code: A Simple Method for Large Language Model Augmented Code Search'☆18Sep 30, 2024Updated last year
- Implement the essential operators from Allens Interval Algebra, and also some metaprogramming for combinatoral operators☆13Oct 17, 2018Updated 7 years ago
- Data and related code for ACL2019 paper "Implicit Discourse Relation Identification for Open-domain Dialogues"☆12Jul 29, 2019Updated 7 years ago
- terraform project structure demonstration and best practice☆23Mar 16, 2024Updated 2 years ago
- Automated Semantic Analysis of Discourse Markers☆11May 30, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- An abductive reasoning engine written in C++.☆13Dec 28, 2018Updated 7 years ago
- Code repository for the WWW 2019 paper "Predicting ConceptNet Path Quality Using Crowdsourced Assessments of Naturalness"☆12Feb 1, 2019Updated 7 years ago
- Resources accompanying the "Zero-Shot Recommendation as Language Modeling" paper (ECIR2022)☆14May 25, 2023Updated 3 years ago
- [ECAI 2023] Official implementation of "FATRER: Full-Attention Topic Regularizer for Accurate and Robust Conversational Emotion Recogniti…☆13Oct 9, 2023Updated 2 years ago
- Code and sample images described in the paper "DeepScribe: Localization and Classification of Elamite Cuneiform Signs Via Deep Learning"☆15Dec 29, 2024Updated last year
- Implementation of our paper "Exploiting Unsupervised Data for Emotion Recognition in Conversations" in the Findings of EMNLP-2020.☆13Nov 17, 2020Updated 5 years ago
- ☆20Feb 11, 2024Updated 2 years ago
- Write maintainable regular expressions☆21Nov 26, 2025Updated 8 months ago
- leveldb FUSE filesystem☆16May 15, 2014Updated 12 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆13Dec 4, 2022Updated 3 years ago
- An open-source NLP library: fast text cleaning and preprocessing☆23Nov 9, 2021Updated 4 years ago
- An implementation of Defeasible Logic in Python☆15Sep 2, 2018Updated 7 years ago
- Final Year Masters Project: modal logic solver tableaux☆25May 26, 2022Updated 4 years ago
- Visual and Embodied Concepts evaluation benchmark☆21Oct 10, 2023Updated 2 years ago
- ☆12Jul 28, 2023Updated 3 years ago
- GQR, a Fast Reasoner for Binary Qualitative Constraint Calculi☆21Nov 11, 2017Updated 8 years ago