athina-ai / athina-evals
Python SDK for running evaluations on LLM generated responses
☆278Updated last week
Alternatives and similar repositories for athina-evals:
Users that are interested in athina-evals are comparing it to the libraries listed below
- Prompt engineering, automated.☆304Updated 2 weeks ago
- Tutorial for building LLM router☆198Updated 9 months ago
- Super performant RAG pipelines for AI apps. Summarization, Retrieve/Rerank and Code Interpreters in one simple API.☆369Updated last year
- Data-Driven Evaluation for LLM-Powered Applications☆489Updated 3 months ago
- The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…☆237Updated 7 months ago
- An Awesome list of curated DSPy resources.☆311Updated 2 months ago
- Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…☆237Updated last week
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆76Updated 2 months ago
- 🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.☆511Updated this week
- The easiest, and fastest way to run AI-generated Python code safely☆304Updated 5 months ago
- A tool for evaluating LLMs☆418Updated 11 months ago
- ☆195Updated last year
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆142Updated last year
- A simple Python sandbox for helpful LLM data agents☆253Updated 10 months ago
- Action library for AI Agent☆214Updated last month
- Lightweight and portable LLM sandbox runtime (code interpreter) Python library.☆255Updated last week
- Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.☆297Updated 5 months ago
- FastAPI wrapper around DSPy☆238Updated last year
- ☆339Updated last week
- This repository shares end-to-end notebooks on how to use various Weaviate features and integrations!☆743Updated this week
- Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)☆263Updated last year
- An Intelligence Operating System☆324Updated this week
- Synthetic Data for LLM Fine-Tuning☆115Updated last year
- OpenTelemetry Instrumentation for AI Observability☆392Updated this week
- 🦜💯 Flex those feathers!☆245Updated 6 months ago
- The open-source SDK for creating AI plugins and actions☆297Updated 3 weeks ago
- AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.☆468Updated last week
- A curated list of open source repositories for AI Engineers☆111Updated last month
- Python client library for improving your LLM app accuracy☆98Updated 2 months ago
- Open-source RAG evaluation through users' feedback☆182Updated last year