athina-ai / athina-evals
Python SDK for running evaluations on LLM generated responses
☆276Updated last week
Alternatives and similar repositories for athina-evals:
Users that are interested in athina-evals are comparing it to the libraries listed below
- Prompt engineering, automated.☆299Updated 3 weeks ago
- An Awesome list of curated DSPy resources.☆305Updated last month
- Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…☆234Updated last week
- The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…☆236Updated 6 months ago
- Super performant RAG pipelines for AI apps. Summarization, Retrieve/Rerank and Code Interpreters in one simple API.☆367Updated 11 months ago
- An Intelligence Operating System☆323Updated last week
- Text analytics for LLM apps. Cluster messages to detect use cases, outliers, power users. Detect intents and run evals with LLM (OpenAI, …☆427Updated 3 weeks ago
- A tool for evaluating LLMs☆413Updated 11 months ago
- 🦜💯 Flex those feathers!☆244Updated 5 months ago
- Action library for AI Agent☆212Updated 2 weeks ago
- ☆311Updated this week
- Readymade evaluators for your LLM apps☆224Updated last week
- A simple Python sandbox for helpful LLM data agents☆247Updated 9 months ago
- Tutorial for building LLM router☆193Updated 8 months ago
- ⛓️ build cognitive systems, pythonic☆333Updated 4 months ago
- Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.☆293Updated 5 months ago
- Data-Driven Evaluation for LLM-Powered Applications☆487Updated 2 months ago
- Open-source RAG evaluation through users' feedback☆180Updated last year
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆144Updated last year
- Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)☆263Updated last year
- The easiest, and fastest way to run AI-generated Python code safely☆295Updated 4 months ago
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆122Updated 5 months ago
- FastAPI wrapper around DSPy☆235Updated last year
- Deep Research for your internal data☆305Updated this week
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.☆417Updated last year
- Structured information extraction from documents☆313Updated 6 months ago
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆80Updated last year
- 🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.☆505Updated this week
- ☆114Updated last month
- Open-source AI copilot that lets you chat with your observability data and code 🧙♂️☆341Updated 4 months ago