PhD/MBA-level human-annotated rubrics dataset across Physics, Chemistry, Finance and Consulting
☆32Oct 30, 2025Updated 8 months ago
Alternatives and similar repositories for ProfBench
Users that are interested in ProfBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Open source codebase for PRBench☆18Jan 15, 2026Updated 6 months ago
- ☆16Jul 10, 2023Updated 3 years ago
- Materials for paper "Self-improving World Modelling with Latent Actions"☆20Feb 5, 2026Updated 5 months ago
- Accelerate pretraining by pre-pretraining on formal languages!☆20Feb 13, 2026Updated 5 months ago
- (ACL 2025 Main) Safe: Enhancing Mathematical Reasoning in Large Language Models via Retrospective Step-aware Formal Verification - Offici…☆21Dec 26, 2025Updated 6 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.☆90Jan 29, 2024Updated 2 years ago
- A benchmark for evaluating LLMs on open-ended CS problems. Exploring the Next Frontier of Computer Science.☆272Updated this week
- The implementation for ThreadWeaver Adaptive Threading for Efficient Parallel Reasoning in Language Models☆67Apr 8, 2026Updated 3 months ago
- Probe how GPT-n performs on statutory reasoning☆10Sep 17, 2024Updated last year
- Bayesian Inverse Graphics for Few-Shot Concept Learning☆12Mar 16, 2025Updated last year
- ☆23Jul 5, 2024Updated 2 years ago
- Fine-tuning GPT-2 to generate research paper abstracts☆12Apr 28, 2021Updated 5 years ago
- [COLM 2025] Official code for "When To Solve, When To Verify: Compute-Optimal Problem Solving and Generative Verification for LLM Reasoni…☆15Oct 31, 2025Updated 8 months ago
- Indranet Explorer, a simulated browser☆16Nov 12, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Your finetuned model's back to its original safety standards faster than you can say "SafetyLock"!☆11Oct 16, 2024Updated last year
- SciQAG is a novel framework for automatically generating high-quality science question-answer pairs from a large corpus of scientific lit…☆34Mar 24, 2025Updated last year
- ☆32Jul 8, 2024Updated 2 years ago
- ☆12Aug 6, 2024Updated last year
- Implementation for the paper "Fictitious Synthetic Data Can Improve LLM Factuality via Prerequisite Learning"☆11Jan 10, 2025Updated last year
- ☆13Updated this week
- Benchmark Large Language Models Reliably On Your Data☆18Dec 27, 2025Updated 6 months ago
- KnowMAN: Weakly Supervised Multinomial Adversarial Networks☆12Nov 9, 2021Updated 4 years ago
- ☆16Jul 23, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆11Jan 19, 2025Updated last year
- [ICLR 2025] Code&Data for the paper "Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization"☆15Jun 21, 2024Updated 2 years ago
- Repository for the listwise reranker Rank-K☆16May 23, 2025Updated last year
- ☆15Mar 12, 2024Updated 2 years ago
- Tasks for describing differences between text distributions.☆17Aug 9, 2024Updated last year
- ☆13Sep 12, 2024Updated last year
- Smart commit messages☆18Oct 25, 2024Updated last year
- [ACL 2022] CLUES: A Benchmark for Learning Classifiers using Natural Language Explanations☆10Jun 5, 2022Updated 4 years ago
- Pier is a Harbor fork built for DeepSWE, with stronger support for CLI agents in air-gapped (no-internet) tasks and more faithful, consis…☆122Jul 12, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- mReasoner is a unified computational implementation of the model theory of thinking and reasoning☆16Aug 17, 2023Updated 2 years ago
- A minimalist benchmarking tool designed to test the routine-generation capabilities of LLMs.☆27Nov 28, 2024Updated last year
- Example for a Monty-enabled RLM in DSPy☆20Feb 16, 2026Updated 5 months ago
- implementation of paper "Large Language Models are In-Context Semantic Reasoners rather than Symbolic Reasoners"☆20Aug 17, 2023Updated 2 years ago
- LossHub: Loss Functions Library for Image Classification and Detection☆14Oct 9, 2022Updated 3 years ago
- Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate Speech (ACL-IJCNLP 2021 Findings)☆13Jun 22, 2022Updated 4 years ago
- Aligning Model-Generated Rubrics with Human Standards☆29Mar 3, 2026Updated 4 months ago