kolenaIO / autoarenaLinks
Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation
☆105Updated 8 months ago
Alternatives and similar repositories for autoarena
Users that are interested in autoarena are comparing it to the libraries listed below
Sorting:
- ☆122Updated 6 months ago
- A Lightweight Library for AI Observability☆251Updated 6 months ago
- A project that enables identification and classification of an intent of a message with dynamic labels☆43Updated 8 months ago
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆147Updated last year
- Dynamic Metadata based RAG Framework☆75Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated 10 months ago
- A python implementation of priompt - a neat way of managing context from diverse sources for LLM applications.☆112Updated 2 months ago
- Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.☆92Updated 11 months ago
- Workflows are an event-driven, async-first, step-based way to control the execution flow of AI applications like agents.☆190Updated last week
- Embed anything.☆28Updated last year
- Open-source RAG evaluation through users' feedback☆204Updated last year
- ☆89Updated 4 months ago
- Routing on Random Forest (RoRF)☆203Updated 11 months ago
- The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…☆247Updated 11 months ago
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆84Updated last year
- Research assistant for performing online research on a given topic, using Llamaindex Workflows and Tavily API. Inspired by GPT-Researcher☆167Updated 11 months ago
- Tutorial for building LLM router☆226Updated last year
- Declarative framework to build LLM-based applications☆127Updated 10 months ago
- ☆74Updated 11 months ago
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆135Updated 2 weeks ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆78Updated 6 months ago
- ☆53Updated 10 months ago
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆114Updated 6 months ago
- Agentic RAG to help you build a startup🚀☆55Updated 5 months ago
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆53Updated 10 months ago
- Solving data for LLMs - Create quality synthetic datasets!☆150Updated 7 months ago
- A toolkit for building computer use AI agents☆174Updated 2 months ago
- Testing and evaluation framework for voice agents☆150Updated 3 months ago
- Deep Research for your internal data☆337Updated 3 months ago
- low-code multi-agent automation framework☆257Updated last year