Alternatives and similar repositories for athina-evals

Users that are interested in athina-evals are comparing it to the libraries listed below

• zenbase-ai / core
  Prompt engineering, automated.
  ☆351Updated 8 months ago
• AI-Northstar-Tech / vector-io
  Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…
  ☆264Updated 3 weeks ago
• cohere-ai / cohere-terrarium
  A simple Python sandbox for helpful LLM data agents
  ☆302Updated last year
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆246Updated last year
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆428Updated last year
• superagent-ai / super-rag
  Super performant RAG pipelines for AI apps. Summarization, Retrieve/Rerank and Code Interpreters in one simple API.
  ☆386Updated last year
• ganarajpr / awesome-dspy
  An Awesome list of curated DSPy resources.
  ☆504Updated last month
• misbahsy / RAGTune
  Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)
  ☆264Updated last year
• cohere-ai / quick-start-connectors
  This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…
  ☆155Updated last year
• sheet0 / npi
  Action library for AI Agent
  ☆229Updated 9 months ago
• langchain-ai / langchain-benchmarks
  🦜💯 Flex those feathers!
  ☆255Updated last year
• relari-ai / continuous-eval
  Data-Driven Evaluation for LLM-Powered Applications
  ☆515Updated 11 months ago
• phospho-app / text-analytics-legacy
  Legacy project of an analytics platform for LLM-generated content
  ☆439Updated 5 months ago
• eidolon-ai / eidolon
  The first AI Agent Server, Eidolon is a pluggable Agent SDK and enterprise ready, deployment server for Agentic applications
  ☆480Updated 10 months ago
• diicellman / dspy-rag-fastapi
  FastAPI wrapper around DSPy
  ☆290Updated last year
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆237Updated last year
• 567-labs / kura
  Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…
  ☆408Updated 4 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆241Updated last year
• firecrawl / rag-arena
  Open-source RAG evaluation through users' feedback
  ☆213Updated last year
• parea-ai / parea-sdk-py
  Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
  ☆82Updated 11 months ago
• jxnl / n-levels-of-rag
  ☆198Updated last year
• connery-io / connery-sdk
  The open-source SDK for creating AI plugins and actions
  ☆298Updated 8 months ago
• khive-ai / lionagi
  AGI SDK
  ☆380Updated 3 weeks ago
• reworkd / bananalyzer
  Open source AI Agent evaluation framework for web tasks 🐒🍌
  ☆326Updated last year
• tjmlabs / AgentRun
  The easiest, and fastest way to run AI-generated Python code safely
  ☆354Updated last year
• defog-ai / introspect
  Deep Research for your internal data
  ☆352Updated 7 months ago
• ammirsm / llamaindex-omakase-rag
  This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…
  ☆147Updated last year
• MagnivOrg / prompt-layer-library
  🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.
  ☆722Updated this week
• simbianai / taskgen
  Task-based Agentic Framework using StrictJSON as the core
  ☆462Updated last month
• tg1482 / priomptipy
  A python implementation of priompt - a neat way of managing context from diverse sources for LLM applications.
  ☆114Updated 6 months ago