kolenaIO / autoarenaLinks
Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation
☆105Updated 10 months ago
Alternatives and similar repositories for autoarena
Users that are interested in autoarena are comparing it to the libraries listed below
Sorting:
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆147Updated last year
- A Lightweight Library for AI Observability☆251Updated 8 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated last year
- Dynamic Metadata based RAG Framework☆77Updated last year
- A project that enables identification and classification of an intent of a message with dynamic labels☆47Updated 10 months ago
- simplifies the process of creating and managing LLM workflows.☆111Updated last year
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆83Updated last year
- ☆124Updated 8 months ago
- Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.☆92Updated last year
- ☆74Updated last year
- ☆73Updated last year
- Tutorial for building LLM router☆233Updated last year
- Research assistant for performing online research on a given topic, using Llamaindex Workflows and Tavily API. Inspired by GPT-Researcher☆168Updated last year
- ☆89Updated 6 months ago
- Agentic RAG to help you build a startup🚀☆55Updated 7 months ago
- LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores a…☆66Updated 2 weeks ago
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆136Updated 2 months ago
- This project involves using llamaindex Multi Agents concierge system and Qdrant vector database to customize the RAG application with use…☆56Updated last year
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆53Updated last year
- Turn topics, links, and files into AI-generated research notebooks — summarize, explore, and ask anything.☆141Updated 5 months ago
- RAG with postgreSQL(nebius) and pgvector☆24Updated 11 months ago
- Create-tsi is a generative AI RAG toolkit which generates AI Applications with low code.☆235Updated last year
- Graphite Agentic Framework by Binome Technologies☆171Updated 2 weeks ago
- Routing on Random Forest (RoRF)☆218Updated last year
- This repo is the central repo for all the RAG Evaluation reference material and partner workshop☆76Updated 6 months ago
- Declarative framework to build LLM-based applications☆128Updated last year
- RAGArch is a Streamlit-based application that empowers users to experiment with various components and parameters of Retrieval-Augmented …☆88Updated last year
- The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…☆247Updated last year
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆123Updated 8 months ago
- Testing and evaluation framework for voice agents☆154Updated 5 months ago