Alternatives and similar repositories for langProBe

Users that are interested in langProBe are comparing it to the libraries listed below

• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆218Updated 5 months ago
• ntunlp / ExecEval
  A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.
  ☆59Updated last year
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆286Updated last week
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆134Updated last year
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆134Updated last year
• princeton-nlp / AutoCompressors
  [EMNLP 2023] Adapting Language Models to Compress Long Contexts
  ☆318Updated last year
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆219Updated 3 weeks ago
• xlang-ai / BRIGHT
  [ICLR 2025] BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆178Updated 2 months ago
• ScalerLab / JudgeBench
  ☆105Updated last year
• ekwinox117 / multi-challenge
  ☆64Updated 9 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆254Updated 7 months ago
• StonyBrookNLP / appworld
  🌍 AppWorld: A Controllable World of Apps and People for Benchmarking Function Calling and Interactive Coding Agent, ACL'24 Best Resource…
  ☆317Updated 2 weeks ago
• QwenLM / ProcessBench
  Official repository for ACL 2025 paper "ProcessBench: Identifying Process Errors in Mathematical Reasoning"
  ☆177Updated 6 months ago
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆128Updated last year
• princeton-nlp / ProLong
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆237Updated 2 months ago
• R2E-Gym / R2E-Gym
  [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents
  ☆197Updated 4 months ago
• Zayne-sprague / MuSR
  ☆56Updated last year
• lilakk / BooookScore
  A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…
  ☆128Updated last year
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆246Updated last year
• lmarena / PPE
  ☆59Updated 6 months ago
• zorazrw / awesome-tool-llm
  ☆241Updated last year
• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆125Updated last year
• facebookresearch / ReasonIR
  Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".
  ☆205Updated 5 months ago
• zankner / CLoud
  Critique-out-Loud Reward Models
  ☆70Updated last year
• texttron / BrowseComp-Plus
  BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent
  ☆115Updated last month
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆223Updated last year
• StonyBrookNLP / musique
  Repository for MuSiQue: Multi-hop Questions via Single-hop Question Composition, TACL 2022
  ☆177Updated last year
• AlexTMallen / adaptive-retrieval
  ☆189Updated 4 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 8 months ago
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆133Updated last year