Alternatives and similar repositories for holobench

Users that are interested in holobench are comparing it to the libraries listed below

• CodeCreator / datatools
  Common tools for data processing
  ☆18Updated 2 weeks ago
• PKU-Baichuan-MLSystemLab / SysBench
  SysBench: Can Large Language Models Follow System Messages?
  ☆34Updated last year
• thunlp / LEAD
  Enhancing Legal Case Retrieval via Scaling High-quality Synthetic Query-Candidate Pairs (EMNLP 2024)
  ☆14Updated 9 months ago
• SeaEval / SeaEval
  NAACL 2024: SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning
  ☆25Updated 6 months ago
• Yibin-Lei / MetaEOL
  Implementation for ACL 2024 paper "Meta-Task Prompting Elicits Embeddings from Large Language Models"
  ☆12Updated last year
• ielab / PromptReps
  Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval
  ☆51Updated 2 months ago
• zhliu0106 / probing-lm-data
  Official Implementation of "Probing Language Models for Pre-training Data Detection"
  ☆19Updated 9 months ago
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆62Updated last year
• orionw / rank1
  Test-time compute in information retrieval
  ☆42Updated last month
• technion-cs-nlp / hallucination-mitigation
  ☆22Updated 8 months ago
• xlang-ai / BRIGHT
  [ICLR 2025] BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆163Updated 3 months ago
• xu1998hz / InstructScore_SEScore3
  First explanation metric (diagnostic report) for text generation evaluation
  ☆62Updated 6 months ago
• ryokamoi / llm-self-correction-papers
  List of papers on Self-Correction of LLMs.
  ☆74Updated 8 months ago
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆45Updated last year
• chtmp223 / suri
  Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)
  ☆25Updated 9 months ago
• zjunlp / LightThinker
  [EMNLP 2025] LightThinker: Thinking Step-by-Step Compression
  ☆83Updated 4 months ago
• neulab / data-agora
  [ACL 2025 Main] Official Repository for "Evaluating Language Models as Synthetic Data Generators"
  ☆38Updated 8 months ago
• LeeSureman / MoT
  code for Preprint paper at Arxiv: MoT: Pre-thinking and Recalling Enable ChatGPT to Self-Improve with Memory-of-Thoughts
  ☆22Updated last year
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆42Updated last year
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆41Updated 2 years ago
• hhan1018 / NesTools
  [COLING 2025] NesTools: A Dataset for Evaluating Nested Tool Learning Abilities of Large Language Models
  ☆17Updated 7 months ago
• HKUNLP / STRING
  [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
  ☆77Updated 9 months ago
• edenbiran / HoppingTooLate
  Exploring the Limitations of Large Language Models on Multi-Hop Queries
  ☆27Updated 6 months ago
• INK-USC / FiD-ICL
  "FiD-ICL: A Fusion-in-Decoder Approach for Efficient In-Context Learning" (ACL 2023)
  ☆15Updated 2 years ago
• princeton-nlp / LM-Science-Tutor
  ☆43Updated last year
• yale-nlp / InstruSum
  ☆22Updated last year
• GAIR-NLP / benbench
  Benchmarking Benchmark Leakage in Large Language Models
  ☆55Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆22Updated last year
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆78Updated last year
• texttron / BrowseComp-Plus
  BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent
  ☆68Updated last week