[NeurIPS 2024] A comprehensive benchmark for evaluating critique ability of LLMs
☆50Nov 29, 2024Updated last year
Alternatives and similar repositories for CriticEval
Users that are interested in CriticEval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆25Dec 7, 2022Updated 3 years ago
- ☆10Feb 6, 2025Updated last year
- [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset☆116May 22, 2025Updated last year
- Evaluate the Quality of Critique☆37Jun 1, 2024Updated 2 years ago
- Adding new tasks to T0 without catastrophic forgetting☆33Oct 20, 2022Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Companion code for FanOutQA: Multi-Hop, Multi-Document Question Answering for Large Language Models (ACL 2024)☆63Jul 30, 2026Updated last month
- Generative Judge for Evaluating Alignment☆253Jan 18, 2024Updated 2 years ago
- Wikipedia based dataset to train relationship classifiers and fact extraction models☆25May 25, 2021Updated 5 years ago
- ☆24Dec 2, 2023Updated 2 years ago
- HackerGPT Lite Docs☆20Jun 18, 2026Updated 2 months ago
- ☆18Dec 25, 2023Updated 2 years ago
- Scratchpad/Chain-of-Thought Prompts☆12Jun 6, 2022Updated 4 years ago
- ☆16Mar 22, 2025Updated last year
- [NeurIPS 2025] Bag of Tricks for Inference-time Computation of LLM Reasoning☆16Sep 20, 2025Updated 11 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆15Jun 28, 2025Updated last year
- ☆83Apr 18, 2024Updated 2 years ago
- Easy Data Augmentation for NLP on Chinese☆16Aug 3, 2019Updated 7 years ago
- Good good study, day day ugly☆10Dec 12, 2018Updated 7 years ago
- Pytorch Implementation of "Contrastive Representation Learning for Exemplar-Guided Paraphrase Generation"☆26Nov 14, 2022Updated 3 years ago
- MaXM is a suite of test-only benchmarks for multilingual visual question answering in 7 languages: English (en), French (fr), Hindi (hi),…☆13Jan 16, 2024Updated 2 years ago
- FROM $f(x)$ AND $g(x)$ TO $f(g(x))$: LLMs Learn New Skills in RL by Composing Old Ones☆72Jan 26, 2026Updated 7 months ago
- One implementation of the paper "Controllable Neural Dialogue Summarization with Personal Named Entity Planning" (EMNLP 2022).☆18Nov 9, 2023Updated 2 years ago
- The official repo for "AceCoder: Acing Coder RL via Automated Test-Case Synthesis" [ACL25]☆100Apr 9, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ACL 2023] Gradient Ascent Post-training Enhances Language Model Generalization☆29Sep 12, 2024Updated last year
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆29Updated this week
- Align, a general text alignment function☆15Dec 7, 2023Updated 2 years ago
- A Dataset for Multi-Turn Dialogue Reasoning☆335Oct 7, 2020Updated 5 years ago
- A Comprehensive Benchmark for Software Development.☆138May 30, 2024Updated 2 years ago
- [NAACL 2025] Representing Rule-based Chatbots with Transformers☆23Feb 9, 2025Updated last year
- Critique-out-Loud Reward Models☆76Oct 18, 2024Updated last year
- ☆45Oct 7, 2024Updated last year
- All-in-one repository for Fine-tuning & Pretraining (Large) Language Models☆15Mar 8, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Group R-CNN for Point-based Weakly Semi-supervised Object Detection (CVPR2022)☆136May 24, 2023Updated 3 years ago
- Evaluating LLMs' multi-round chatting capability via assessing conversations generated by two LLM instances.☆163May 22, 2025Updated last year
- Official PyTorch implementation of "MM-PoisonRAG: Disrupting Multimodal RAG with Local and Global Poisoning Attacks"☆18Dec 4, 2025Updated 8 months ago
- Counting-Stars (★)☆84Nov 24, 2025Updated 9 months ago
- [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets☆218Dec 24, 2023Updated 2 years ago
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)☆104Feb 20, 2025Updated last year
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆89Aug 10, 2024Updated 2 years ago