[NeurIPS 2024] A comprehensive benchmark for evaluating critique ability of LLMs
☆51Nov 29, 2024Updated last year
Alternatives and similar repositories for CriticEval
Users that are interested in CriticEval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset☆118May 22, 2025Updated last year
- ☆25Dec 7, 2022Updated 3 years ago
- Evaluate the Quality of Critique☆37Jun 1, 2024Updated 2 years ago
- From Accuracy to Robustness: A Study of Rule- and Model-based Verifiers in Mathematical Reasoning.☆25Oct 7, 2025Updated last year
- Repository for "Scaling Evaluation-time Compute with Reasoning Models as Process Evaluators"☆12Mar 25, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ACL2024] T-Eval: Evaluating Tool Utilization Capability of Large Language Models Step by Step☆313Apr 3, 2024Updated 2 years ago
- Adding new tasks to T0 without catastrophic forgetting☆33Oct 20, 2022Updated 4 years ago
- Generative Judge for Evaluating Alignment☆253Jan 18, 2024Updated 2 years ago
- ☆36Sep 26, 2024Updated 2 years ago
- exploring whether LLMs perform case-based or rule-based reasoning☆31Mar 2, 2024Updated 2 years ago
- This is the repo for the paper Shepherd -- A Critic for Language Model Generation☆225Aug 10, 2023Updated 3 years ago
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆29Updated this week
- official repo for the paper "Learning From Mistakes Makes LLM Better Reasoner"☆62Dec 20, 2023Updated 2 years ago
- [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models☆121Jun 12, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The All-in-one Judge Models introduced by Opencompass☆122Jul 15, 2025Updated last year
- The code for Mask-based Decoupling-Fusing Network☆22Dec 14, 2020Updated 5 years ago
- Original code for our work on Sentiment Look-ahead.☆18Apr 27, 2021Updated 5 years ago
- A simple Google Search Engine Crawler.☆22Feb 16, 2024Updated 2 years ago
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆90Aug 10, 2024Updated 2 years ago
- [ECCV2022] Dense Siamese Network for Dense Unsupervised Learning☆29Jul 21, 2022Updated 4 years ago
- Wikipedia based dataset to train relationship classifiers and fact extraction models☆25May 25, 2021Updated 5 years ago
- ☆45Oct 7, 2024Updated 2 years ago
- Group R-CNN for Point-based Weakly Semi-supervised Object Detection (CVPR2022)☆136May 24, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- FROM $f(x)$ AND $g(x)$ TO $f(g(x))$: LLMs Learn New Skills in RL by Composing Old Ones☆73Jan 26, 2026Updated 9 months ago
- ☆24Dec 2, 2023Updated 2 years ago
- ☆18Dec 25, 2023Updated 2 years ago
- Scratchpad/Chain-of-Thought Prompts☆12Jun 6, 2022Updated 4 years ago
- The sources codes of the DR-BERT model and baselines☆37Nov 17, 2021Updated 4 years ago
- Evaluating LLMs' multi-round chatting capability via assessing conversations generated by two LLM instances.☆163May 22, 2025Updated last year
- Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models☆132Jul 20, 2025Updated last year
- ICML'25: The Devil Is in the Details: Tackling Unimodal Spurious Correlations for Generalizable Multimodal Reward Models☆11May 19, 2025Updated last year
- DreamPRM tackles the dataset quality imbalance and distribution shift that plague multimodal PRM training by domain-reweighting.☆24Sep 6, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆16Mar 22, 2025Updated last year
- ☆83Apr 18, 2024Updated 2 years ago
- [ACL2024 Findings] Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models☆363Mar 22, 2024Updated 2 years ago
- [ACL 2024] ANAH & [NeurIPS 2024] ANAH-v2 & [ICLR 2025] Mask-DPO☆67Apr 30, 2025Updated last year
- Easy Data Augmentation for NLP on Chinese☆16Aug 3, 2019Updated 7 years ago
- Good good study, day day ugly☆10Dec 12, 2018Updated 7 years ago
- A Comprehensive Benchmark for Software Development.☆139May 30, 2024Updated 2 years ago