kolenaIO / autoarenaLinks
Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation
☆108Updated last year
Alternatives and similar repositories for autoarena
Users that are interested in autoarena are comparing it to the libraries listed below
Sorting:
- A project that enables identification and classification of an intent of a message with dynamic labels☆49Updated last year
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆147Updated last year
- Dynamic Metadata based RAG Framework☆78Updated last week
- A python implementation of priompt - a neat way of managing context from diverse sources for LLM applications.☆113Updated 5 months ago
- ☆125Updated 9 months ago
- ☆89Updated 7 months ago
- Workflows are an event-driven, async-first, step-based way to control the execution flow of AI applications like agents.☆280Updated this week
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆54Updated last year
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆147Updated last year
- simplifies the process of creating and managing LLM workflows.☆112Updated last year
- low-code multi-agent automation framework☆265Updated last month
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated last year
- Open-source RAG evaluation through users' feedback☆209Updated last year
- This repo is the central repo for all the RAG Evaluation reference material and partner workshop☆77Updated 7 months ago
- A Lightweight Library for AI Observability☆252Updated 9 months ago
- A toolkit for building computer use AI agents☆180Updated 5 months ago
- Declarative framework to build LLM-based applications☆129Updated last year
- RAG example using DSPy, Gradio, FastAPI☆86Updated last year
- Create-tsi is a generative AI RAG toolkit which generates AI Applications with low code.☆235Updated last year
- LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores a…☆69Updated last week
- Testing and evaluation framework for voice agents☆160Updated 6 months ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆81Updated 10 months ago
- Lyzr SDKs help you to build all your favorite GenAI SaaS products as enterprise applications in minutes.☆189Updated last year
- Graphite Agentic Framework by Binome Technologies☆172Updated last week
- Embed anything.☆27Updated last year
- Collaborative Multi-Agent RAG with CrewAI☆68Updated last year
- 🚀 A list of Haystack Integrations, maintained by the community or deepset.☆98Updated this week
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆115Updated 8 months ago
- ☆74Updated last year
- Routing on Random Forest (RoRF)☆229Updated last year