kolenaIO / autoarenaLinks
Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation
☆105Updated 6 months ago
Alternatives and similar repositories for autoarena
Users that are interested in autoarena are comparing it to the libraries listed below
Sorting:
- Dynamic Metadata based RAG Framework☆75Updated 11 months ago
- ☆122Updated 4 months ago
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆145Updated last year
- Routing on Random Forest (RoRF)☆176Updated 9 months ago
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆144Updated last year
- Tutorial for building LLM router☆216Updated 11 months ago
- A python implementation of priompt - a neat way of managing context from diverse sources for LLM applications.☆111Updated 11 months ago
- A project that enables identification and classification of an intent of a message with dynamic labels☆41Updated 6 months ago
- ☆120Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆72Updated 8 months ago
- Embed anything.☆28Updated last year
- A Lightweight Library for AI Observability☆246Updated 4 months ago
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆81Updated last year
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆108Updated 3 months ago
- ☆87Updated 2 months ago
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆132Updated last month
- The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…☆243Updated 9 months ago
- Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.☆92Updated 9 months ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆78Updated 5 months ago
- Open-source RAG evaluation through users' feedback☆191Updated last year
- A list of AI memory projects☆168Updated 6 months ago
- Automated knowledge graph creation SDK☆122Updated 7 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆80Updated 3 months ago
- Create-tsi is a generative AI RAG toolkit which generates AI Applications with low code.☆233Updated 8 months ago
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆106Updated 4 months ago
- A reimplementation of langgraph's customer support example in Rasa's CALM paradigm and a quantiative evaluation of the 2 approaches☆80Updated 3 months ago
- Lyzr SDKs help you to build all your favorite GenAI SaaS products as enterprise applications in minutes.☆180Updated 7 months ago
- LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores a…☆60Updated 3 weeks ago
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆126Updated 8 months ago
- ☆89Updated last year