Alternatives and similar repositories for ai-agent-benchmark-compendium

Users that are interested in ai-agent-benchmark-compendium are comparing it to the libraries listed below

• jxnl / instructor-classify
  ☆37Updated 8 months ago
• miralab-ai / autoreason
  ☆39Updated last year
• jmanhype / dspy-self-discover-framework
  Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…
  ☆72Updated 2 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆107Updated 4 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆114Updated 9 months ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆99Updated 3 months ago
• dair-ai / m2-deep-research
  Deep research agents using MiniMax M2.1 interleaved thinking
  ☆194Updated last month
• avbiswas / context-engineering-dspy
  Context Engineering Course with DSPy
  ☆211Updated 6 months ago
• facebookresearch / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆34Updated 9 months ago
• Osmosis-AI / Osmosis-Apply-1.7B-MCP
  A mcp server that uses the Osmosis-Apply-1.7B model to apply code merges
  ☆53Updated 6 months ago
• huggingface / screensuite
  ScreenSuite - The most comprehensive benchmarking suite for GUI Agents!
  ☆135Updated 4 months ago
• axeld5 / pali_reason
  Testing paligemma2 finetuning on reasoning dataset
  ☆18Updated last year
• AtakanTekparmak / agento
  Very minimal (and stateless) agent framework
  ☆44Updated last year
• sunnweiwei / PPP-Agent
  ☆95Updated last week
• zenbase-ai / py-priompt
  Prompt design in Python
  ☆65Updated last year
• JeezAI / DSPy_matchmaking
  A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…
  ☆59Updated last year
• MaximeRivest / functai
  ☆85Updated 4 months ago
• hammer-mt / DSPyUI
  A user interface for DSPy
  ☆210Updated 3 months ago
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆90Updated last month
• Arize-ai / prompt-learning
  ☆269Updated last week
• tom-doerr / dspy_reasoning
  ☆94Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• allenai / autodiscovery
  Official code for NeurIPS 2025 paper "AutoDiscovery: Open-ended Scientific Discovery via Bayesian Surprise"
  ☆125Updated last week
• sony / talkhier
  Official Repo for The Paper "Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systems"
  ☆60Updated 11 months ago
• tom-doerr / mnist_dspy
  ☆36Updated 11 months ago
• agno-agi / agentos-railway
  ☆78Updated last month
• AsyncFuncAI / alphaxiv-open
  alphaxiv open source alternative
  ☆107Updated 8 months ago
• weaviate / retrieve-dspy
  A collection of Compound Retrieval Systems implemented with DSPy and Weaviate.
  ☆94Updated 3 weeks ago
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆186Updated last week
• shoggoth13 / agents-deconstructed
  ☆57Updated 2 years ago