kolenaIO / autoarenaLinks
Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation
☆105Updated 8 months ago
Alternatives and similar repositories for autoarena
Users that are interested in autoarena are comparing it to the libraries listed below
Sorting:
- Routing on Random Forest (RoRF)☆191Updated 10 months ago
- Testing and evaluation framework for voice agents☆143Updated 2 months ago
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆146Updated last year
- A project that enables identification and classification of an intent of a message with dynamic labels☆43Updated 8 months ago
- Dynamic Metadata based RAG Framework☆75Updated last year
- Tutorial for building LLM router☆223Updated last year
- A Lightweight Library for AI Observability☆250Updated 6 months ago
- ☆122Updated 5 months ago
- A python implementation of priompt - a neat way of managing context from diverse sources for LLM applications.☆112Updated last month
- Declarative framework to build LLM-based applications☆126Updated 9 months ago
- A toolkit for building computer use AI agents☆172Updated last month
- Deep Research for your internal data☆337Updated 2 months ago
- Lyzr SDKs help you to build all your favorite GenAI SaaS products as enterprise applications in minutes.☆183Updated 8 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆76Updated 9 months ago
- Workflows are an event-driven, async-first, step-based way to control the execution flow of AI applications like agents.☆163Updated this week
- Turn topics, links, and files into AI-generated research notebooks — summarize, explore, and ask anything.☆133Updated 2 months ago
- A list of AI memory projects☆195Updated 7 months ago
- Not Diamond Python SDK☆87Updated this week
- Create-tsi is a generative AI RAG toolkit which generates AI Applications with low code.☆234Updated 9 months ago
- Building a Chain of Thought RAG Model with DSPy, Qdrant and Ollama☆32Updated last year
- LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores a…☆65Updated this week
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆84Updated 5 months ago
- Open-source RAG evaluation through users' feedback☆200Updated last year
- simplifies the process of creating and managing LLM workflows.☆108Updated 10 months ago
- Embed anything.☆28Updated last year
- ☆74Updated 10 months ago
- Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.☆92Updated 10 months ago
- This project involves using llamaindex Multi Agents concierge system and Qdrant vector database to customize the RAG application with use…☆56Updated last year
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆133Updated 2 months ago
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆147Updated last year