Alternatives and similar repositories for insight-bench

Users that are interested in insight-bench are comparing it to the libraries listed below

• ryoungj / ToolEmu
  [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
  ☆174Updated last year
• tianyang-x / SaySelf
  Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"
  ☆112Updated last year
• DataArcTech / LLM-as-a-Judge
  ☆163Updated 2 months ago
• snap-stanford / MLAgentBench
  ☆321Updated last year
• LiqiangJing / DSBench
  [ICLR 2025] DSBench: How Far are Data Science Agents from Becoming Data Science Experts?
  ☆95Updated 4 months ago
• zorazrw / awesome-tool-llm
  ☆242Updated last year
• zjunlp / KnowledgeCircuits
  [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers
  ☆160Updated last month
• multi-agent-systems-failure-taxonomy / MAST
  ☆306Updated 5 months ago
• declare-lab / trust-align
  Codes and datasets for the paper Measuring and Enhancing Trustworthiness of LLMs in RAG through Grounded Attributions and Learning to Ref…
  ☆69Updated 9 months ago
• zhangxjohn / LLM-Agent-Benchmark-List
  A banchmark list for evaluation of large language models.
  ☆152Updated 3 months ago
• rxlqn / awesome-llm-self-reflection
  augmented LLM with self reflection
  ☆135Updated 2 years ago
• ulab-uiuc / MARBLE
  (ACL 2025 Main) Code for MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents https://www.arxiv.org/pdf/2503.019…
  ☆197Updated last month
• shengliu66 / ICV
  Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
  ☆196Updated 10 months ago
• suzgunmirac / dynamic-cheatsheet
  Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory
  ☆229Updated 7 months ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆112Updated 4 months ago
• xlang-ai / Spider2-V
  [NeurIPS 2024] Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?
  ☆135Updated last year
• zjunlp / WKM
  [NeurIPS 2024] Agent Planning with World Knowledge Model
  ☆158Updated last year
• StonyBrookNLP / appworld
  🌍 AppWorld: A Controllable World of Apps and People for Benchmarking Function Calling and Interactive Coding Agent, ACL'24 Best Resource…
  ☆346Updated last month
• InfiAgent / InfiAgent
  InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks (ICML 2024)
  ☆162Updated 6 months ago
• SALT-NLP / DyLAN
  Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization
  ☆189Updated last year
• facebookresearch / ReasonIR
  Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".
  ☆212Updated 6 months ago
• hkust-nlp / AgentBoard
  An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]
  ☆375Updated last year
• kevinwu23 / StanfordClashEval
  ☆37Updated 11 months ago
• kohjingyu / search-agents
  Code for the paper 🌳 Tree Search for Language Model Agents
  ☆216Updated last year
• yueyu1030 / AttrPrompt
  [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.
  ☆156Updated 2 years ago
• gauss5930 / LLM-Agora
  LLM Agora, debating between open-source LLMs to refine the answers
  ☆84Updated 2 years ago
• SALT-NLP / collaborative-gym
  Framework and toolkits for building and evaluating collaborative agents that can work together with humans.
  ☆113Updated 3 weeks ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆158Updated 6 months ago
• ScalerLab / JudgeBench
  ☆107Updated last year
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆132Updated last year