Alternatives and similar repositories for langProBe

Users that are interested in langProBe are comparing it to the libraries listed below

• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆225Updated 7 months ago
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆136Updated last year
• lmarena / PPE
  ☆62Updated 8 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆246Updated last year
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆132Updated last year
• ekwinox117 / multi-challenge
  ☆77Updated last year
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆227Updated last year
• zorazrw / awesome-tool-llm
  ☆242Updated last year
• lilakk / BooookScore
  A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…
  ☆128Updated last year
• texttron / BrowseComp-Plus
  BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent
  ☆169Updated last month
• SuperBruceJia / Awesome-LLM-Self-Consistency
  Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models
  ☆119Updated 6 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆261Updated 9 months ago
• xlang-ai / BRIGHT
  [ICLR 2025] BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆189Updated 4 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆337Updated last week
• ScalerLab / JudgeBench
  ☆107Updated last year
• Zayne-sprague / MuSR
  ☆56Updated last year
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆140Updated last year
• ZitongYang / Synthetic_Continued_Pretraining
  Code implementation of synthetic continued pretraining
  ☆148Updated last year
• R2E-Gym / R2E-Gym
  [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents
  ☆230Updated 6 months ago
• princeton-nlp / HELMET
  The HELMET Benchmark
  ☆198Updated 2 months ago
• XiangLi1999 / AutoBencher
  ☆32Updated last year
• AlexTMallen / adaptive-retrieval
  ☆187Updated 7 months ago
• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆129Updated last year
• asaparov / prontoqa
  Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.
  ☆154Updated 5 months ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆119Updated 2 years ago
• swj0419 / in-context-pretraining
  ☆55Updated last year
• princeton-nlp / AutoCompressors
  [EMNLP 2023] Adapting Language Models to Compress Long Contexts
  ☆328Updated last year
• HowieHwong / MetaTool
  [ICLR 2024] MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use
  ☆107Updated last year
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆78Updated 2 years ago
• HKUNLP / STRING
  [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
  ☆78Updated last year