Alternatives and similar repositories for ai-agent-benchmark-compendium

Users that are interested in ai-agent-benchmark-compendium are comparing it to the libraries listed below

• jmanhype / dspy-self-discover-framework
  Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…
  ☆72Updated 3 weeks ago
• jxnl / instructor-classify
  ☆36Updated 6 months ago
• weaviate / retrieve-dspy
  A collection of Compound Retrieval Systems implemented with DSPy and Weaviate.
  ☆91Updated last month
• allenai / autodiscovery
  Official code for NeurIPS 2025 paper "AutoDiscovery: Open-ended Scientific Discovery via Bayesian Surprise"
  ☆95Updated this week
• tom-doerr / mnist_dspy
  ☆36Updated 9 months ago
• MaximeRivest / functai
  ☆83Updated 2 months ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆93Updated last month
• zenbase-ai / py-priompt
  Prompt design in Python
  ☆63Updated last year
• aymeric-roucher / LongContext_vs_RAG_NeedleInAHaystack
  Comparing retrieval abilities from GPT4-Turbo and a RAG system on a toy example for various context lengths
  ☆35Updated last year
• otriscon / llm-structured-output
  ☆90Updated 10 months ago
• AtakanTekparmak / agento
  Very minimal (and stateless) agent framework
  ☆45Updated 10 months ago
• huggingface / screensuite
  ScreenSuite - The most comprehensive benchmarking suite for GUI Agents!
  ☆132Updated 2 months ago
• lightblue-tech / lb-reranker
  ☆24Updated 10 months ago
• JeezAI / DSPy_matchmaking
  A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…
  ☆59Updated last year
• evalops / dspy-micro-agent
  Minimal agent runtime built with DSPy modules and a thin Python loop. Includes CLI, FastAPI server, and eval harness with OpenAI/Ollama s…
  ☆65Updated 2 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆106Updated 2 months ago
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆88Updated this week
• shoggoth13 / agents-deconstructed
  ☆57Updated 2 years ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆113Updated 7 months ago
• sunnweiwei / PPP-Agent
  ☆88Updated 3 weeks ago
• hammer-mt / DSPyUI
  A user interface for DSPy
  ☆198Updated last month
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• Osmosis-AI / Osmosis-Apply-1.7B-MCP
  A mcp server that uses the Osmosis-Apply-1.7B model to apply code merges
  ☆53Updated 4 months ago
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆67Updated 6 months ago
• Columbia-NLP-Lab / PAPILLON
  Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles
  ☆60Updated 6 months ago
• Technoculture / personal-graph
  Simple Graph Memory for AI applications
  ☆89Updated 6 months ago
• fsndzomga / baby_agi_dspy
  a version of baby agi using dspy and typed predictors
  ☆17Updated last year
• Vaibhavs10 / 2024-ai-timeline
  ☆73Updated 10 months ago
• Archelunch / vibe-dspy
  ☆50Updated 3 months ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆40Updated last year