Alternatives and similar repositories for athina-evals

Users that are interested in athina-evals are comparing it to the libraries listed below

• zenbase-ai / core
  Prompt engineering, automated.
  ☆343Updated 5 months ago
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆248Updated 11 months ago
• ganarajpr / awesome-dspy
  An Awesome list of curated DSPy resources.
  ☆439Updated last month
• AI-Northstar-Tech / vector-io
  Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…
  ☆260Updated last week
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆424Updated last year
• relari-ai / continuous-eval
  Data-Driven Evaluation for LLM-Powered Applications
  ☆506Updated 8 months ago
• phospho-app / text-analytics-legacy
  Legacy project
  ☆438Updated 2 months ago
• superagent-ai / super-rag
  Super performant RAG pipelines for AI apps. Summarization, Retrieve/Rerank and Code Interpreters in one simple API.
  ☆387Updated last year
• cohere-ai / cohere-terrarium
  A simple Python sandbox for helpful LLM data agents
  ☆285Updated last year
• sheet0 / npi
  Action library for AI Agent
  ☆224Updated 6 months ago
• misbahsy / RAGTune
  Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)
  ☆264Updated last year
• langchain-ai / langchain-benchmarks
  🦜💯 Flex those feathers!
  ☆252Updated 11 months ago
• diicellman / dspy-rag-fastapi
  FastAPI wrapper around DSPy
  ☆271Updated last year
• simbianai / taskgen
  Task-based Agentic Framework using StrictJSON as the core
  ☆459Updated last month
• stanford-oval / suql
  SUQL: Conversational Search over Structured and Unstructured Data with LLMs
  ☆285Updated 2 months ago
• saharmor / voice-lab
  Testing and evaluation framework for voice agents
  ☆151Updated 3 months ago
• cohere-ai / quick-start-connectors
  This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…
  ☆151Updated 11 months ago
• firecrawl / rag-arena
  Open-source RAG evaluation through users' feedback
  ☆204Updated last year
• TonicAI / tonic_validate
  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
  ☆318Updated 2 months ago
• parea-ai / parea-sdk-py
  Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
  ☆79Updated 7 months ago
• MagnivOrg / prompt-layer-library
  🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.
  ☆671Updated 3 weeks ago
• defog-ai / introspect
  Deep Research for your internal data
  ☆338Updated 3 months ago
• SciPhi-AI / agent-search
  AgentSearch is a framework for powering search agents and enabling customizable local search.
  ☆508Updated last year
• hwchase17 / langfuzz
  ☆73Updated 11 months ago
• aryn-ai / sycamore
  🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.
  ☆562Updated this week
• langwatch / langevals
  LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores a…
  ☆65Updated 2 weeks ago
• PragmaticMachineLearning / docai
  Structured information extraction from documents
  ☆317Updated last year
• anyscale / llm-router
  Tutorial for building LLM router
  ☆228Updated last year
• Arize-ai / openinference
  OpenTelemetry Instrumentation for AI Observability
  ☆608Updated last week
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆211Updated last year