Alternatives and similar repositories for holobench

Users that are interested in holobench are comparing it to the libraries listed below

• CodeCreator / datatools
  Common tools for data processing
  ☆17Updated 4 months ago
• thunlp / LEAD
  Enhancing Legal Case Retrieval via Scaling High-quality Synthetic Query-Candidate Pairs (EMNLP 2024)
  ☆13Updated 8 months ago
• PKU-Baichuan-MLSystemLab / SysBench
  SysBench: Can Large Language Models Follow System Messages?
  ☆33Updated 11 months ago
• Yibin-Lei / MetaEOL
  Implementation for ACL 2024 paper "Meta-Task Prompting Elicits Embeddings from Large Language Models"
  ☆12Updated last year
• xlang-ai / BRIGHT
  BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆153Updated 2 months ago
• ielab / PromptReps
  Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval
  ☆50Updated last month
• HKUNLP / STRING
  [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
  ☆77Updated 8 months ago
• edenbiran / HoppingTooLate
  Exploring the Limitations of Large Language Models on Multi-Hop Queries
  ☆27Updated 5 months ago
• chenzhiling9954 / Critical-Tokens-Matter
  ☆38Updated 2 months ago
• ryokamoi / llm-self-correction-papers
  List of papers on Self-Correction of LLMs.
  ☆74Updated 7 months ago
• Glaciohound / LM-Steer
  Official Code Repository for LM-Steer Paper: "Word Embeddings Are Steers for Language Models" (ACL 2024 Outstanding Paper Award)
  ☆123Updated last month
• hanxuhu / SeqIns
  The repository of the project "Fine-tuning Large Language Models with Sequential Instructions", code base comes from open-instruct and LA…
  ☆29Updated 8 months ago
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆78Updated last year
• orionw / rank1
  Test-time compute in information retrieval
  ☆38Updated last month
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆22Updated 11 months ago
• INK-USC / FiD-ICL
  "FiD-ICL: A Fusion-in-Decoder Approach for Efficient In-Context Learning" (ACL 2023)
  ☆15Updated 2 years ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆58Updated 10 months ago
• LuLuLuyi / LongHeads
  [EMNLP'24] LongHeads: Multi-Head Attention is Secretly a Long Context Processor
  ☆29Updated last year
• ntunlp / LLMSanitize
  An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).
  ☆57Updated last year
• zjunlp / LightThinker
  LightThinker: Thinking Step-by-Step Compression
  ☆68Updated 4 months ago
• RUC-NLPIR / fullrank
  ☆26Updated last month
• SeaEval / SeaEval
  NAACL 2024: SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning
  ☆25Updated 5 months ago
• project-miracl / hagrid
  A Human-LLM Collaborative Dataset for Generative Information-seeking with Attribution
  ☆35Updated 2 years ago
• starrYYxuan / UniTE
  ☆13Updated 8 months ago
• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆114Updated last year
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆108Updated 3 months ago
• GAIR-NLP / benbench
  Benchmarking Benchmark Leakage in Large Language Models
  ☆55Updated last year
• zhliu0106 / probing-lm-data
  Official Implementation of "Probing Language Models for Pre-training Data Detection"
  ☆19Updated 8 months ago
• sdiehl / prm
  Library for training process reward models
  ☆27Updated 2 months ago
• Alab-NII / 2wikimultihop
  ☆115Updated last year