Alternatives and similar repositories for eval

Users that are interested in eval are comparing it to the libraries listed below

• voyage-ai / voyageai-python
  Voyage AI Official Python Library
  ☆91Updated last week
• hwchase17 / chain-of-verification
  ☆33Updated 2 years ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆115Updated 9 months ago
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆90Updated last month
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆46Updated 3 weeks ago
• agential-ai / agential
  🔔🧠 Easily experiment with popular language agents across diverse reasoning/decision-making benchmarks!
  ☆53Updated 6 months ago
• llllvvuu / instant_apply
  proof-of-concept of Cursor's Instant Apply feature
  ☆88Updated last year
• neoxelox / dspy-inspector
  DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.
  ☆44Updated last year
• OSU-NLP-Group / SeeActChromeExtension
  ☆18Updated last year
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆132Updated this week
• sony / talkhier
  Official Repo for The Paper "Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systems"
  ☆60Updated 11 months ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆99Updated 4 months ago
• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆79Updated last year
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆239Updated last year
• agentsea / surfkit
  A toolkit for building computer use AI agents
  ☆182Updated 7 months ago
• BhabhaAI / dataformer
  Solving data for LLMs - Create quality synthetic datasets!
  ☆151Updated last year
• MinorJerry / OpenWebVoyager
  ☆87Updated last year
• jjovalle99 / DSPy-Text2SQL
  DSPY on action with OpenSource LLMs.
  ☆103Updated last year
• FanaHOVA / openai-o1-code-interpreter
  Code interpreter support for o1
  ☆31Updated last year
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 10 months ago
• seanchatmangpt / dspygen
  A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.
  ☆132Updated last year
• langchain-ai / kork
  Natural Language Interfaces Powered by LLMs
  ☆95Updated last year
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆57Updated last year
• cfahlgren1 / hf-data-explorer
  Chrome Extension for exploring Hugging Face datasets 🔎
  ☆48Updated last year
• jacoblee93 / oss-model-extraction-evals
  ☆30Updated last year
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆92Updated last year
• parkervg / blendsql
  Query language for blending SQL and local language models across structured + unstructured data, with type constraints.
  ☆159Updated this week
• OpenPipe / open_deep_research_training
  Training setup for Langchain's Open Deep Research
  ☆74Updated 5 months ago
• Halluminate / WebBench
  📚 Benchmark your browser agent on ~2.5k READ and ACTION based tasks
  ☆85Updated 6 months ago
• yasyf / anthropic-computer-use-modal
  Anthropic Computer Use with Modal Sandboxes
  ☆43Updated last year