kolenaIO / autoarenaLinks
Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation
☆108Updated last year
Alternatives and similar repositories for autoarena
Users that are interested in autoarena are comparing it to the libraries listed below
Sorting:
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆84Updated last year
- ☆125Updated 11 months ago
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆147Updated last year
- A python implementation of priompt - a neat way of managing context from diverse sources for LLM applications.☆115Updated 7 months ago
- A toolkit for building computer use AI agents☆182Updated 7 months ago
- Create-tsi is a generative AI RAG toolkit which generates AI Applications with low code.☆235Updated last year
- Dynamic Metadata based RAG Framework☆78Updated 2 months ago
- A Lightweight Library for AI Observability☆255Updated 11 months ago
- Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.☆93Updated last year
- A project that enables identification and classification of an intent of a message with dynamic labels☆50Updated last year
- Declarative framework to build LLM-based applications☆130Updated last year
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆82Updated 11 months ago
- Tutorial for building LLM router☆244Updated last year
- Embed anything.☆27Updated last year
- A memory framework for Large Language Models and Agents.☆181Updated last year
- ☆74Updated last year
- Testing and evaluation framework for voice agents☆162Updated 8 months ago
- Open-source RAG evaluation through users' feedback☆215Updated last year
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆115Updated 10 months ago
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆133Updated 11 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆90Updated 2 months ago
- Routing on Random Forest (RoRF)☆239Updated last year
- 🤖 Headless IDE for AI agents☆200Updated 4 months ago
- Research assistant for performing online research on a given topic, using Llamaindex Workflows and Tavily API. Inspired by GPT-Researcher☆169Updated last year
- Graphite Agentic Framework by Binome Technologies☆172Updated last month
- simplifies the process of creating and managing LLM workflows.☆113Updated last year
- LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores a…☆70Updated last week
- The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…☆248Updated last year
- The long-term memory for your Superagents 🥷and LLMs 🤖. Built with GraphRAG, Knowledge graphs and autonomous ai agents☆63Updated last year
- ☆89Updated 9 months ago