kolenaIO / autoarena
Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation
☆103Updated 3 months ago
Alternatives and similar repositories for autoarena:
Users that are interested in autoarena are comparing it to the libraries listed below
- ☆78Updated 6 months ago
- Tutorial for building LLM router☆186Updated 8 months ago
- A project that enables identification and classification of an intent of a message with dynamic labels☆36Updated 3 months ago
- Lyzr SDKs help you to build all your favorite GenAI SaaS products as enterprise applications in minutes.☆175Updated 3 months ago
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆117Updated 3 weeks ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆77Updated last month
- Testing and evaluation framework for voice agents☆98Updated last month
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆50Updated 4 months ago
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆141Updated 11 months ago
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆122Updated 5 months ago
- ☆119Updated last month
- ☆68Updated 6 months ago
- ☆71Updated 5 months ago
- Routing on Random Forest (RoRF)☆136Updated 6 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆104Updated 3 months ago
- This project involves using llamaindex Multi Agents concierge system and Qdrant vector database to customize the RAG application with use…☆48Updated 7 months ago
- Optimized Large Language Models for Financial Applications – Efficient, Scalable, and Domain-Specific AI for Finance.☆43Updated 3 weeks ago
- Dynamic Metadata based RAG Framework☆72Updated 7 months ago
- Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.☆90Updated 5 months ago
- RAGArch is a Streamlit-based application that empowers users to experiment with various components and parameters of Retrieval-Augmented …☆84Updated last year
- LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores a…☆47Updated this week
- A Lightweight Library for AI Observability☆238Updated last month
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆64Updated 4 months ago
- This project implements the "Modular RAG" framework using Haystack & Hypster☆31Updated 4 months ago
- ☆142Updated 8 months ago
- A reimplementation of langgraph's customer support example in Rasa's CALM paradigm and a quantiative evaluation of the 2 approaches☆76Updated this week
- ☆82Updated 3 weeks ago
- Solving data for LLMs - Create quality synthetic datasets!☆145Updated 2 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆59Updated 7 months ago
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆160Updated 6 months ago