Yifan-Song793 / GoodBadGreedyLinks
The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism
☆30Updated last year
Alternatives and similar repositories for GoodBadGreedy
Users that are interested in GoodBadGreedy are comparing it to the libraries listed below
Sorting:
- Visual and Embodied Concepts evaluation benchmark☆21Updated last year
- ☆14Updated last year
- BeHonest: Benchmarking Honesty in Large Language Models☆34Updated last year
- Code for "[COLM'25] RepoST: Scalable Repository-Level Coding Environment Construction with Sandbox Testing"☆21Updated 5 months ago
- The repository of the project "Fine-tuning Large Language Models with Sequential Instructions", code base comes from open-instruct and LA…☆29Updated 9 months ago
- [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy☆69Updated 8 months ago
- ☆59Updated last year
- ☆30Updated 8 months ago
- Pitfalls of Rule- and Model-based Verifiers: A Case Study on Mathematical Reasoning.☆23Updated 3 months ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆63Updated last year
- Source code of "Reasons to Reject? Aligning Language Models with Judgments"☆58Updated last year
- Methods and evaluation for aligning language models temporally☆29Updated last year
- The rule-based evaluation subset and code implementation of Omni-MATH☆22Updated 8 months ago
- [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning☆27Updated last year
- The official repo of "WebExplorer: Explore and Evolve for Training Long-Horizon Web Agents"☆42Updated this week
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆51Updated 3 months ago
- RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment☆16Updated 8 months ago
- This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"☆50Updated 10 months ago
- ☆49Updated 10 months ago
- ☆41Updated last year
- Evaluate the Quality of Critique☆36Updated last year
- A curated list of awesome resources dedicated to Scaling Laws for LLMs☆77Updated 2 years ago
- ☆17Updated 10 months ago
- The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"☆38Updated last year
- Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning☆36Updated 2 years ago
- Official repository for ACL 2025 paper "Model Extrapolation Expedites Alignment"☆75Updated 3 months ago
- instruction-following benchmark for large reasoning models☆40Updated last month
- The official repository for the paper "From Zero to Hero: Examining the Power of Symbolic Tasks in Instruction Tuning".☆66Updated 2 years ago
- Analyzing LLM Alignment via Token distribution shift☆17Updated last year
- [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models☆19Updated 2 years ago