Alternatives and similar repositories for assistantbench

Users that are interested in assistantbench are comparing it to the libraries listed below

• asappresearch / webagents-step
  ☆41Updated last year
• SalesforceAIResearch / LaTRO
  ☆123Updated 11 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆96Updated 8 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆61Updated last year
• OSU-NLP-Group / Middleware
  Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)
  ☆37Updated last year
• allenai / super-benchmark
  ☆49Updated 10 months ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆80Updated 9 months ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆43Updated last year
• JHU-CLSP / RATIONALYST
  Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044
  ☆35Updated last year
• arcee-ai / DAM
  ☆56Updated last year
• allenai / IFBench
  ☆102Updated last month
• allenai / infinigram-api
  ☆93Updated last month
• dinobby / MAgICoRE
  ☆23Updated last year
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 11 months ago
• voidism / Lookback-Lens
  Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"
  ☆142Updated 3 months ago
• allenai / clin
  ☆87Updated 2 years ago
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆19Updated last year
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆153Updated last year
• dinobby / MAGDi
  The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…
  ☆40Updated 2 years ago
• sher222 / LeReT
  Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval
  ☆51Updated last year
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆148Updated last year
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆66Updated 2 years ago
• austrian-code-wizard / c3po
  ☆29Updated last month
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆175Updated last year
• yueqis / API-Based-Agent
  ☆61Updated 7 months ago
• SalesforceAIResearch / swecomm
  ☆28Updated 3 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆169Updated last year
• Alex-Gurung / ReasoningNCP
  Official repo for Learning to Reason for Long-Form Story Generation
  ☆74Updated 9 months ago
• sunblaze-ucb / reasoning_ladder
  ☆35Updated 8 months ago