kolenaIO / autoarena
Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation
☆103Updated 4 months ago
Alternatives and similar repositories for autoarena:
Users that are interested in autoarena are comparing it to the libraries listed below
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆142Updated last year
- A python implementation of priompt - a neat way of managing context from diverse sources for LLM applications.☆109Updated 9 months ago
- ☆121Updated 2 months ago
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆50Updated 6 months ago
- LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores a…☆54Updated this week
- Tutorial for building LLM router☆198Updated 9 months ago
- Declarative framework to build LLM-based applications☆118Updated 5 months ago
- ☆93Updated 5 months ago
- A project that enables identification and classification of an intent of a message with dynamic labels☆39Updated 4 months ago
- Testing and evaluation framework for voice agents☆114Updated this week
- Named Entity Recognition using Claude Citations☆73Updated last month
- simplifies the process of creating and managing LLM workflows.☆100Updated 6 months ago
- ☆88Updated last year
- Chat to your Database GenAI Chatbot☆34Updated 4 months ago
- ☆81Updated 7 months ago
- Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.☆90Updated 6 months ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆76Updated 2 months ago
- RAG example using DSPy, Gradio, FastAPI☆79Updated last year
- A Lightweight Library for AI Observability☆243Updated 2 months ago
- ☆68Updated 7 months ago
- A flexible, adaptive classification system for dynamic text classification☆160Updated last month
- ☆72Updated 6 months ago
- Dabarqus is incredibly fast RAG that runs everywhere.☆57Updated 3 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆105Updated 3 weeks ago
- Dynamic Metadata based RAG Framework☆75Updated 9 months ago
- A reimplementation of langgraph's customer support example in Rasa's CALM paradigm and a quantiative evaluation of the 2 approaches☆80Updated last month
- Embed anything.☆29Updated 11 months ago
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆123Updated 6 months ago
- RAGArch is a Streamlit-based application that empowers users to experiment with various components and parameters of Retrieval-Augmented …☆84Updated last year
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 7 months ago