SeekingDream / Static-to-Dynamic-LLMEvalLinks
The official GitHub repository of the paper "Recent advances in large langauge model benchmarks against data contamination: From static to dynamic evaluation"
☆49Updated 3 months ago
Alternatives and similar repositories for Static-to-Dynamic-LLMEval
Users that are interested in Static-to-Dynamic-LLMEval are comparing it to the libraries listed below
Sorting:
- Code for Research Project TLDR☆24Updated 5 months ago
- [ACL' 25] The official code repository for PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models.☆86Updated 10 months ago
- Code and data for "ConflictBank: A Benchmark for Evaluating the Influence of Knowledge Conflicts in LLM" (NeurIPS 2024 Track Datasets and…☆63Updated 7 months ago
- BeHonest: Benchmarking Honesty in Large Language Models☆34Updated last year
- Laser: Learn to Reason Efficiently with Adaptive Length-based Reward Shaping☆61Updated 7 months ago
- [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".☆83Updated 11 months ago
- Multilingual safety benchmark for Large Language Models☆54Updated last year
- ☆52Updated 3 months ago
- [2025-TMLR] A Survey on the Honesty of Large Language Models☆64Updated last year
- Official code for paper "SPA-RL: Reinforcing LLM Agent via Stepwise Progress Attribution"☆60Updated 3 months ago
- Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".☆55Updated last year
- Code and Data for Paper "AutoTIR: Autonomous Tools Integrated Reasoning via Reinforcement Learning"☆47Updated 3 months ago
- ☆51Updated last year
- Safety-J: Evaluating Safety with Critique☆16Updated last year
- ☆71Updated 8 months ago
- Model merging is a highly efficient approach for long-to-short reasoning.☆94Updated 2 months ago
- Code for "CREAM: Consistency Regularized Self-Rewarding Language Models", ICLR 2025.☆28Updated 10 months ago
- The implementation of paper "LLM Critics Help Catch Bugs in Mathematics: Towards a Better Mathematical Verifier with Natural Language Fee…☆37Updated last year
- Code and data for "Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?" (ACL 2024)☆32Updated last year
- A comprehensive collection of process reward models.☆129Updated 2 months ago
- A versatile toolkit for applying Logit Lens to modern large language models (LLMs). Currently supports Llama-3.1-8B and Qwen-2.5-7B, enab…☆140Updated 4 months ago
- Resources and paper list for 'Scaling Environments for Agents'. This repository accompanies our survey on how environments contribute to …☆49Updated last week
- [ACL 2024 (Oral)] A Prospector of Long-Dependency Data for Large Language Models☆58Updated last year
- Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning☆168Updated last year
- [ACL 2025] A Neural-Symbolic Self-Training Framework☆117Updated 7 months ago
- [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy☆76Updated 2 months ago
- ☆77Updated last year
- Reproducing R1 for Code with Reliable Rewards☆12Updated 8 months ago
- [ICLR 2025] Language Imbalance Driven Rewarding for Multilingual Self-improving☆24Updated 4 months ago
- The rule-based evaluation subset and code implementation of Omni-MATH☆26Updated last year