Alternatives and similar repositories for benbench:

Users that are interested in benbench are comparing it to the libraries listed below

• kaistAI / Janus
  [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messages
  ☆42Updated 2 months ago
• ChengpengLi1003 / DotaMath
  ☆28Updated last month
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆55Updated 7 months ago
• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆35Updated 8 months ago
• neulab / data-agora
  [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"
  ☆34Updated 2 months ago
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆39Updated last year
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆33Updated 4 months ago
• wzhouad / WPO
  Code and models for EMNLP 2024 paper "WPO: Enhancing RLHF with Weighted Preference Optimization"
  ☆37Updated 4 months ago
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆44Updated last month
• GAIR-NLP / ReasonEval
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆48Updated 2 months ago
• kaistAI / InstructIR
  IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…
  ☆31Updated 8 months ago
• PrasannS / rlhf-length-biases
  ☆27Updated 11 months ago
• xlang-ai / BRIGHT
  BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆75Updated last week
• chujiezheng / LLM-Extrapolation
  Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"
  ☆72Updated 8 months ago
• hbin0701 / Self-Explore
  [EMNLP Findings 2024 & ACL 2024 NLRSE Oral] Enhancing Mathematical Reasoning in Language Models with Fine-grained Rewards
  ☆48Updated 9 months ago
• GAIR-NLP / weak-to-strong-reasoning
  ☆58Updated 5 months ago
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆31Updated 5 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated 11 months ago
• chtmp223 / suri
  Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)
  ☆22Updated 3 months ago
• icip-cas / Verifier-Engineering
  Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering
  ☆55Updated 2 months ago
• THU-KEG / RM-Bench
  [ICLR 24 Oral] RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style
  ☆17Updated last week
• GAIR-NLP / self-improvement-reversal
  ☆13Updated 7 months ago
• swj0419 / in-context-pretraining
  ☆47Updated 10 months ago
• Zayne-sprague / MuSR
  ☆39Updated 6 months ago
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆19Updated 6 months ago
• wwxu21 / CUT
  Source code of "Reasons to Reject? Aligning Language Models with Judgments"
  ☆58Updated 11 months ago
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆21Updated 2 months ago
• INK-USC / FiD-ICL
  "FiD-ICL: A Fusion-in-Decoder Approach for Efficient In-Context Learning" (ACL 2023)
  ☆13Updated last year