Alternatives and similar repositories for holobench

Users that are interested in holobench are comparing it to the libraries listed below

• CodeCreator / datatools
  Common tools for data processing
  ☆22Updated 3 weeks ago
• PKU-Baichuan-MLSystemLab / SysBench
  SysBench: Can Large Language Models Follow System Messages?
  ☆37Updated last year
• thunlp / LEAD
  Enhancing Legal Case Retrieval via Scaling High-quality Synthetic Query-Candidate Pairs (EMNLP 2024)
  ☆16Updated last year
• orionw / rank1
  Test-time compute in information retrieval
  ☆47Updated 5 months ago
• Geralt-Targaryen / MC-Evaluation
  ☆13Updated last year
• xlang-ai / BRIGHT
  [ICLR 2025] BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆181Updated 3 months ago
• ryokamoi / llm-self-correction-papers
  List of papers on Self-Correction of LLMs.
  ☆81Updated last year
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆49Updated last year
• zhliu0106 / probing-lm-data
  Official Implementation of "Probing Language Models for Pre-training Data Detection"
  ☆20Updated last year
• BunsenFeng / AbstainQA
  AbstainQA, ACL 2024
  ☆28Updated last year
• RUC-NLPIR / fullrank
  ☆37Updated last month
• Alab-NII / 2wikimultihop
  ☆131Updated 2 years ago
• apple / ml-dataset-decomposition
  Official repo of dataset-decomposition paper [NeurIPS 2024]
  ☆20Updated 11 months ago
• INK-USC / FiD-ICL
  "FiD-ICL: A Fusion-in-Decoder Approach for Efficient In-Context Learning" (ACL 2023)
  ☆15Updated 2 years ago
• HKUNLP / STRING
  [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
  ☆78Updated last year
• OSU-NLP-Group / In-Context-Reranking
  [ICLR'25] "Attention in Large Language Models Yields Efficient Zero-Shot Re-Rankers"
  ☆40Updated 8 months ago
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆64Updated last year
• aypan17 / latentqa
  ☆26Updated last month
• zhiyuanhubj / LongRecipe
  LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models
  ☆78Updated last year
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆51Updated 6 months ago
• Yibin-Lei / MetaEOL
  Implementation for ACL 2024 paper "Meta-Task Prompting Elicits Embeddings from Large Language Models"
  ☆12Updated last year
• ielab / PromptReps
  Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval
  ☆51Updated 6 months ago
• texttron / BrowseComp-Plus
  BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent
  ☆136Updated 2 weeks ago
• Zayne-sprague / MuSR
  ☆56Updated last year
• castorini / perm-sc
  Official codebase for permutation self-consistency.
  ☆18Updated last year
• chtmp223 / suri
  Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)
  ☆27Updated 2 months ago
• cxcscmu / MATES
  Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]
  ☆76Updated last year
• chenzhiling9954 / Critical-Tokens-Matter
  ☆47Updated 7 months ago
• princeton-pli / LongProc
  LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation
  ☆33Updated 2 months ago
• OSU-NLP-Group / LLM-Knowledge-Conflict
  [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"
  ☆79Updated last year