GAIR-NLP / BeHonest
BeHonest: Benchmarking Honesty in Large Language Models
☆31Updated 6 months ago
Alternatives and similar repositories for BeHonest:
Users that are interested in BeHonest are comparing it to the libraries listed below
- ☆13Updated 7 months ago
- ☆72Updated 8 months ago
- Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"☆63Updated 11 months ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆55Updated 7 months ago
- [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".☆68Updated last month
- ☆58Updated 5 months ago
- The repository of the project "Fine-tuning Large Language Models with Sequential Instructions", code base comes from open-instruct and LA…☆29Updated 2 months ago
- LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation☆18Updated 3 weeks ago
- Evaluate the Quality of Critique☆35Updated 8 months ago
- Evaluating the Ripple Effects of Knowledge Editing in Language Models☆53Updated 10 months ago
- Safety-J: Evaluating Safety with Critique☆16Updated 6 months ago
- ☆14Updated 3 months ago
- ☆28Updated last month
- [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy☆48Updated 2 months ago
- Code and data for "ConflictBank: A Benchmark for Evaluating the Influence of Knowledge Conflicts in LLM" (NeurIPS 2024 Track Datasets and…☆36Updated 3 months ago
- [NAACL'25] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆47Updated 2 months ago
- ☆41Updated 3 months ago
- GPT as Human☆18Updated 2 months ago
- ☆64Updated 10 months ago
- ☆35Updated 3 months ago
- M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning☆55Updated last month
- [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"☆65Updated 10 months ago
- ☆38Updated last year
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆72Updated 8 months ago
- [EMNLP 2023] Plan, Verify and Switch: Integrated Reasoning with Diverse X-of-Thoughts☆26Updated last year
- RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment☆14Updated 2 months ago
- Towards Systematic Measurement for Long Text Quality☆31Updated 5 months ago
- Analyzing LLM Alignment via Token distribution shift☆15Updated last year
- The rule-based evaluation subset and code implementation of Omni-MATH☆16Updated last month