Alternatives and similar repositories for assistantbench

Users that are interested in assistantbench are comparing it to the libraries listed below

• asappresearch / webagents-step
  ☆41Updated last year
• allenai / super-benchmark
  ☆49Updated 10 months ago
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆96Updated 8 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆61Updated last year
• SalesforceAIResearch / LaTRO
  ☆123Updated 11 months ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆80Updated 9 months ago
• sunblaze-ucb / reasoning_ladder
  ☆35Updated 8 months ago
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆66Updated 2 years ago
• yueqis / API-Based-Agent
  ☆61Updated 7 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• allenai / clin
  ☆87Updated 2 years ago
• austrian-code-wizard / c3po
  ☆29Updated last month
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆90Updated 9 months ago
• JHU-CLSP / RATIONALYST
  Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044
  ☆35Updated last year
• du-nlp-lab / MLR-Copilot
  ☆67Updated 10 months ago
• InternLM / SWE-Fixer
  ☆131Updated 9 months ago
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆19Updated last year
• OSU-NLP-Group / Middleware
  Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)
  ☆37Updated last year
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆43Updated last year
• dxhou / CoAct
  ☆32Updated last year
• architsharma97 / dpo-rlaif
  ☆99Updated last year
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆56Updated 7 months ago
• arcee-ai / DAM
  ☆56Updated last year
• voidism / Lookback-Lens
  Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"
  ☆142Updated 3 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆91Updated last year
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆119Updated 9 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 11 months ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆153Updated last year
• SalesforceAIResearch / swecomm
  ☆28Updated 3 months ago
• SALT-NLP / collaborative-gym
  Framework and toolkits for building and evaluating collaborative agents that can work together with humans.
  ☆120Updated 2 months ago