Alternatives and similar repositories for agentic-benchmarks

Users that are interested in agentic-benchmarks are comparing it to the libraries listed below

• allenai / IFBench
  ☆64Updated last month
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆69Updated 3 months ago
• austrian-code-wizard / c3po
  ☆29Updated this week
• martin-wey / CodeUltraFeedback
  CodeUltraFeedback: aligning large language models to coding preferences
  ☆71Updated last year
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆53Updated last month
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆59Updated 8 months ago
• SalesforceAIResearch / CodeTree
  Code for the paper: CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models
  ☆24Updated 4 months ago
• ryokamoi / llm-self-correction-papers
  List of papers on Self-Correction of LLMs.
  ☆74Updated 7 months ago
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated last year
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆92Updated 2 months ago
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆58Updated 3 months ago
• allenai / super-benchmark
  ☆45Updated 4 months ago
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 6 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 6 months ago
• xhan77 / in-context-alignment
  In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning
  ☆35Updated 2 years ago
• limenlp / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated last year
• xlang-ai / computer-agent-arena
  Computer Agent Arena: Test & compare AI agents in real desktop apps & web environments. Code/data coming soon!
  ☆47Updated 4 months ago
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆29Updated last year
• ulab-uiuc / ToMAP
  Official code repository for the paper "ToMAP: Training Opponent-Aware LLM Persuaders with Theory of Mind"
  ☆14Updated 2 months ago
• LeonEricsson / llmjudge
  Exploring limitations of LLM-as-a-judge
  ☆19Updated 11 months ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• arcee-ai / DAM
  ☆53Updated 9 months ago
• allenai / infinigram-api
  ☆73Updated 3 weeks ago
• IBM / InspectorRAGet
  The repository contains generative AI analytics platform application code.
  ☆26Updated 3 months ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆43Updated last year
• likenneth / persona_drift
  Measuring and Controlling Persona Drift in Language Model Dialogs
  ☆17Updated last year
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆48Updated 6 months ago
• locuslab / scaling_laws_data_filtering
  ☆65Updated last year
• nec-research / agentquest
  ☆28Updated 4 months ago