kolenaIO / autoarenaLinks
Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation
☆107Updated 11 months ago
Alternatives and similar repositories for autoarena
Users that are interested in autoarena are comparing it to the libraries listed below
Sorting:
- Dynamic Metadata based RAG Framework☆78Updated last year
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆147Updated last year
- ☆124Updated 9 months ago
- A Lightweight Library for AI Observability☆251Updated 9 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated last year
- A project that enables identification and classification of an intent of a message with dynamic labels☆49Updated 11 months ago
- A memory framework for Large Language Models and Agents.☆184Updated 11 months ago
- A python implementation of priompt - a neat way of managing context from diverse sources for LLM applications.☆113Updated 4 months ago
- Routing on Random Forest (RoRF)☆222Updated last year
- Tutorial for building LLM router☆236Updated last year
- ☆89Updated 6 months ago
- Declarative framework to build LLM-based applications☆128Updated last year
- A reimplementation of langgraph's customer support example in Rasa's CALM paradigm and a quantiative evaluation of the 2 approaches☆81Updated 8 months ago
- Your local personalised AI agent☆42Updated last year
- Research assistant for performing online research on a given topic, using Llamaindex Workflows and Tavily API. Inspired by GPT-Researcher☆168Updated last year
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆147Updated last year
- low-code multi-agent automation framework☆264Updated last month
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆83Updated last year
- Automated knowledge graph creation SDK☆122Updated last year
- Create-tsi is a generative AI RAG toolkit which generates AI Applications with low code.☆235Updated last year
- Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.☆92Updated last year
- AI-powered tools to automate code documentation and optimize developer operations.☆40Updated 2 weeks ago
- This repo is the central repo for all the RAG Evaluation reference material and partner workshop☆76Updated 7 months ago
- Testing and evaluation framework for voice agents☆158Updated 5 months ago
- Solving data for LLMs - Create quality synthetic datasets!☆150Updated 10 months ago
- Workflows are an event-driven, async-first, step-based way to control the execution flow of AI applications like agents.☆271Updated this week
- The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…☆247Updated last year
- Simple examples using Argilla tools to build AI☆56Updated last year
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆88Updated this week
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆113Updated 7 months ago