Alternatives and similar repositories for assistantbench

Users that are interested in assistantbench are comparing it to the libraries listed below

• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated 10 months ago
• allenai / super-benchmark
  ☆45Updated 3 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 9 months ago
• asappresearch / webagents-step
  ☆40Updated 11 months ago
• allenai / clin
  ☆83Updated last year
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆80Updated 2 months ago
• SalesforceAIResearch / LaTRO
  ☆117Updated 4 months ago
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆91Updated last month
• allenai / IFBench
  ☆52Updated last week
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆64Updated 2 months ago
• OSU-NLP-Group / Middleware
  Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)
  ☆37Updated 6 months ago
• allenai / infinigram-api
  ☆69Updated last month
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆149Updated 5 months ago
• sher222 / LeReT
  Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval
  ☆39Updated 8 months ago
• yueqis / API-Based-Agent
  ☆50Updated 2 weeks ago
• arcee-ai / DAM
  ☆52Updated 8 months ago
• McGill-NLP / weblinx
  WebLINX is a benchmark for building web navigation agents with conversational capabilities
  ☆153Updated 5 months ago
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆18Updated 8 months ago
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆99Updated 2 weeks ago
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆48Updated this week
• InternLM / SWE-Fixer
  ☆104Updated 2 months ago
• austrian-code-wizard / c3po
  ☆27Updated last week
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆32Updated 2 months ago
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆138Updated 7 months ago
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆65Updated 2 years ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆173Updated 4 months ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆97Updated 2 months ago
• SALT-NLP / demonstrated-feedback
  ☆124Updated 9 months ago
• xlang-ai / OSWorld-G
  Scaling Computer-Use Grounding via UI Decomposition and Synthesis
  ☆85Updated 3 weeks ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆86Updated last year