Alternatives and similar repositories for athina-evals

Users that are interested in athina-evals are comparing it to the libraries listed below

• zenbase-ai / core
  Prompt engineering, automated.
  ☆329Updated 2 months ago
• superagent-ai / super-rag
  Super performant RAG pipelines for AI apps. Summarization, Retrieve/Rerank and Code Interpreters in one simple API.
  ☆377Updated last year
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆419Updated last year
• relari-ai / continuous-eval
  Data-Driven Evaluation for LLM-Powered Applications
  ☆497Updated 5 months ago
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆242Updated 8 months ago
• AI-Northstar-Tech / vector-io
  Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…
  ☆244Updated last week
• cohere-ai / cohere-terrarium
  A simple Python sandbox for helpful LLM data agents
  ☆267Updated last year
• anyscale / llm-router
  Tutorial for building LLM router
  ☆210Updated 11 months ago
• diicellman / dspy-rag-fastapi
  FastAPI wrapper around DSPy
  ☆247Updated last year
• SciPhi-AI / agent-search
  AgentSearch is a framework for powering search agents and enabling customizable local search.
  ☆490Updated last year
• ganarajpr / awesome-dspy
  An Awesome list of curated DSPy resources.
  ☆346Updated 4 months ago
• mendableai / rag-arena
  Open-source RAG evaluation through users' feedback
  ☆188Updated last year
• khive-ai / lionagi
  An Intelligence Operating System
  ☆332Updated last week
• jxnl / n-levels-of-rag
  ☆195Updated last year
• npi-ai / npi
  Action library for AI Agent
  ☆215Updated 2 months ago
• misbahsy / RAGTune
  Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)
  ☆264Updated last year
• Arize-ai / openinference
  OpenTelemetry Instrumentation for AI Observability
  ☆474Updated this week
• parea-ai / parea-sdk-py
  Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
  ☆78Updated 4 months ago
• tjmlabs / AgentRun
  The easiest, and fastest way to run AI-generated Python code safely
  ☆320Updated 6 months ago
• Scale3-Labs / langtrace
  Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, ev…
  ☆954Updated last month
• simbianai / taskgen
  Task-based Agentic Framework using StrictJSON as the core
  ☆452Updated last week
• cohere-ai / quick-start-connectors
  This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…
  ☆150Updated 8 months ago
• ShoggothAI / motleycrew
  Flexible and powerful multi-agent AI framework
  ☆370Updated last month
• MagnivOrg / prompt-layer-library
  🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.
  ☆628Updated this week
• 567-labs / kura
  Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…
  ☆204Updated this week
• eidolon-ai / eidolon
  The first AI Agent Server, Eidolon is a pluggable Agent SDK and enterprise ready, deployment server for Agentic applications
  ☆454Updated 3 months ago
• TonicAI / tonic_validate
  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
  ☆305Updated last month
• aryn-ai / sycamore
  🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.
  ☆527Updated this week
• deepset-ai / prompthub
  ☆167Updated last year
• hwchase17 / langgraph-engineer
  ☆279Updated 2 weeks ago