[NeurIPS 2024] A comprehensive benchmark for evaluating critique ability of LLMs
☆51Nov 29, 2024Updated last year
Alternatives and similar repositories for CriticEval
Users that are interested in CriticEval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset☆117May 22, 2025Updated last year
- ☆25Dec 7, 2022Updated 3 years ago
- Evaluate the Quality of Critique☆37Jun 1, 2024Updated 2 years ago
- ☆10Feb 6, 2025Updated last year
- From Accuracy to Robustness: A Study of Rule- and Model-based Verifiers in Mathematical Reasoning.☆26Oct 7, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Repository for "Scaling Evaluation-time Compute with Reasoning Models as Process Evaluators"☆12Mar 25, 2025Updated last year
- [ACL2024] T-Eval: Evaluating Tool Utilization Capability of Large Language Models Step by Step☆313Apr 3, 2024Updated 2 years ago
- Adding new tasks to T0 without catastrophic forgetting☆33Oct 20, 2022Updated 4 years ago
- Generative Judge for Evaluating Alignment☆253Jan 18, 2024Updated 2 years ago
- ☆36Sep 26, 2024Updated 2 years ago
- Implementation of LREC-COLING 2024 paper A Frustratingly Simple Decoding Method for Neural Text Generation☆19Feb 23, 2024Updated 2 years ago
- exploring whether LLMs perform case-based or rule-based reasoning☆31Mar 2, 2024Updated 2 years ago
- This is the repo for the paper Shepherd -- A Critic for Language Model Generation☆224Aug 10, 2023Updated 3 years ago
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆29Oct 26, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- official repo for the paper "Learning From Mistakes Makes LLM Better Reasoner"☆62Dec 20, 2023Updated 2 years ago
- Companion code for FanOutQA: Multi-Hop, Multi-Document Question Answering for Large Language Models (ACL 2024)☆63Jul 30, 2026Updated 3 months ago
- [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models☆121Jun 12, 2025Updated last year
- Original code for our work on Sentiment Look-ahead.☆18Apr 27, 2021Updated 5 years ago
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆90Aug 10, 2024Updated 2 years ago
- Group R-CNN for Point-based Weakly Semi-supervised Object Detection (CVPR2022)☆136May 24, 2023Updated 3 years ago
- ☆24Dec 2, 2023Updated 2 years ago
- ☆45Oct 7, 2024Updated 2 years ago
- code for AAAI accepted paper Similarity Distribution based Membership Inference Attack on Person Re-Identification.☆11Sep 29, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11Feb 12, 2025Updated last year
- ☆18Dec 25, 2023Updated 2 years ago
- Wikipedia based dataset to train relationship classifiers and fact extraction models☆25May 25, 2021Updated 5 years ago
- Scratchpad/Chain-of-Thought Prompts☆12Jun 6, 2022Updated 4 years ago
- Evaluating LLMs' multi-round chatting capability via assessing conversations generated by two LLM instances.☆163May 22, 2025Updated last year
- ICML'25: The Devil Is in the Details: Tackling Unimodal Spurious Correlations for Generalizable Multimodal Reward Models☆11May 19, 2025Updated last year
- ☆16Mar 22, 2025Updated last year
- The sources codes of the DR-BERT model and baselines☆37Nov 17, 2021Updated 5 years ago
- ☆83Apr 18, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ACL2024 Findings] Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models☆362Mar 22, 2024Updated 2 years ago
- This repository contains the research works presented at the Toward Agentic Finance Systems Workshop 2025, featuring two oral presentatio…☆10Nov 22, 2025Updated last year
- Train toy models using multi-token prediction objective☆14Apr 18, 2026Updated 7 months ago
- Good good study, day day ugly☆10Dec 12, 2018Updated 7 years ago
- A Comprehensive Benchmark for Software Development.☆139May 30, 2024Updated 2 years ago
- Code3DBench: Single-Image to Executable Low-Poly 3D Code Generation☆13Jun 6, 2026Updated 5 months ago
- Collections of RLxLM experiments using minimal codes☆14Feb 17, 2025Updated last year
Are these results useful?