Alternatives and similar repositories for athina-evals:

Users that are interested in athina-evals are comparing it to the libraries listed below

• zenbase-ai / core
  Prompt engineering, automated.
  ☆288Updated 3 months ago
• relari-ai / continuous-eval
  Data-Driven Evaluation for LLM-Powered Applications
  ☆484Updated last month
• AI-Northstar-Tech / vector-io
  Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…
  ☆230Updated this week
• Arize-ai / openinference
  OpenTelemetry Instrumentation for AI Observability
  ☆334Updated this week
• superagent-ai / super-rag
  Super performant RAG pipelines for AI apps. Summarization, Retrieve/Rerank and Code Interpreters in one simple API.
  ☆363Updated 10 months ago
• cohere-ai / cohere-terrarium
  A simple Python sandbox for helpful LLM data agents
  ☆235Updated 9 months ago
• npi-ai / npi
  Action library for AI Agent
  ☆211Updated this week
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆235Updated 5 months ago
• jxnl / n-levels-of-rag
  ☆195Updated 10 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆187Updated 8 months ago
• mendableai / rag-arena
  Open-source RAG evaluation through users' feedback
  ☆179Updated 11 months ago
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆407Updated 10 months ago
• parea-ai / parea-sdk-py
  Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
  ☆76Updated last month
• lion-agi / lionagi
  An Intelligence Operating System
  ☆323Updated this week
• SciPhi-AI / agent-search
  AgentSearch is a framework for powering search agents and enabling customizable local search.
  ☆479Updated 10 months ago
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆112Updated last year
• phospho-app / phospho
  Text analytics for LLM apps. Cluster messages to detect use cases, outliers, power users. Detect intents and run evals with LLM (OpenAI, …
  ☆423Updated 2 months ago
• langchain-ai / agent-protocol
  ☆273Updated last week
• ganarajpr / awesome-dspy
  An Awesome list of curated DSPy resources.
  ☆297Updated last month
• e2b-dev / infra
  Infrastructure for AI code interpreting that's powering E2B.
  ☆339Updated this week
• saharmor / voice-lab
  Testing and evaluation framework for voice agents
  ☆98Updated last month
• langchain-ai / langchain-benchmarks
  🦜💯 Flex those feathers!
  ☆242Updated 5 months ago
• cohere-ai / quick-start-connectors
  This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…
  ☆148Updated 5 months ago
• misbahsy / RAGTune
  Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)
  ☆263Updated last year
• braintrustdata / autoevals
  AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.
  ☆429Updated this week
• athina-ai / ariadne
  LLM Evals for Text Summarization and RAG use-cases.
  ☆35Updated last year
• reworkd / bananalyzer
  Open source AI Agent evaluation framework for web tasks 🐒🍌
  ☆289Updated 2 months ago
• plastic-labs / honcho
  The Identity layer for the agentic world
  ☆171Updated this week
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆135Updated 5 months ago
• timho102003 / NewsGPT
  ☆221Updated last year