kolenaIO / autoarenaLinks
Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation
☆105Updated 9 months ago
Alternatives and similar repositories for autoarena
Users that are interested in autoarena are comparing it to the libraries listed below
Sorting:
- Routing on Random Forest (RoRF)☆211Updated last year
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆147Updated last year
- Dynamic Metadata based RAG Framework☆75Updated last year
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆135Updated last month
- A project that enables identification and classification of an intent of a message with dynamic labels☆44Updated 9 months ago
- A Lightweight Library for AI Observability☆251Updated 7 months ago
- A memory framework for Large Language Models and Agents.☆183Updated 9 months ago
- ☆104Updated 3 months ago
- ☆74Updated last year
- Agentic RAG to help you build a startup🚀☆55Updated 5 months ago
- simplifies the process of creating and managing LLM workflows.☆109Updated 11 months ago
- Embed anything.☆28Updated last year
- Declarative framework to build LLM-based applications☆128Updated 10 months ago
- ☆53Updated 11 months ago
- Open-source RAG evaluation through users' feedback☆204Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated 11 months ago
- Turn topics, links, and files into AI-generated research notebooks — summarize, explore, and ask anything.☆140Updated 3 months ago
- 🤖 Headless IDE for AI agents☆202Updated 5 months ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆79Updated 7 months ago
- Testing and evaluation framework for voice agents☆151Updated 3 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆86Updated 3 weeks ago
- Tutorial for building LLM router☆228Updated last year
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆117Updated 7 months ago
- ☆124Updated 7 months ago
- ☆89Updated last year
- LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores a…☆65Updated 2 weeks ago
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆83Updated last year
- Lyzr SDKs help you to build all your favorite GenAI SaaS products as enterprise applications in minutes.☆184Updated 9 months ago
- A list of AI memory projects☆225Updated 8 months ago
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆54Updated 10 months ago