Alternatives and similar repositories for assistantbench

Users that are interested in assistantbench are comparing it to the libraries listed below

• asappresearch / webagents-step
  ☆41Updated last year
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 10 months ago
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆92Updated 3 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated 11 months ago
• SalesforceAIResearch / LaTRO
  ☆120Updated 6 months ago
• allenai / infinigram-api
  ☆77Updated 2 weeks ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆150Updated 6 months ago
• allenai / super-benchmark
  ☆45Updated 4 months ago
• sher222 / LeReT
  Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval
  ☆49Updated 9 months ago
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆83Updated 3 months ago
• OSU-NLP-Group / Middleware
  Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)
  ☆37Updated 7 months ago
• allenai / IFBench
  ☆66Updated last month
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆70Updated 4 months ago
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆54Updated last month
• allenai / clin
  ☆84Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆105Updated 8 months ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆104Updated 3 months ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆64Updated 2 years ago
• marzenakrp / nocha
  ☆52Updated 9 months ago
• Alex-Gurung / ReasoningNCP
  Official repo for Learning to Reason for Long-Form Story Generation
  ☆68Updated 4 months ago
• JHU-CLSP / RATIONALYST
  Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044
  ☆35Updated 10 months ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆173Updated 7 months ago
• sunblaze-ucb / reasoning_ladder
  ☆35Updated 3 months ago
• swarnaHub / ExplanationIntervention
  [NeurIPS 2023] PyTorch code for Can Language Models Teach? Teacher Explanations Improve Student Performance via Theory of Mind
  ☆66Updated last year
• voidism / Lookback-Lens
  Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"
  ☆130Updated last year
• SALT-NLP / demonstrated-feedback
  ☆126Updated 10 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆33Updated 4 months ago
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆18Updated 9 months ago
• arcee-ai / DAM
  ☆54Updated 9 months ago