Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation
☆108Dec 16, 2024Updated last year
Alternatives and similar repositories for autoarena
Users that are interested in autoarena are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆44May 29, 2025Updated 11 months ago
- ☆23Oct 28, 2024Updated last year
- Turn tracker tickets into agent sessions☆61May 15, 2026Updated last week
- ☆18May 28, 2024Updated last year
- Leveraging Base Language Models for Few-Shot Synthetic Data Generation☆41Oct 18, 2025Updated 7 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Client for the MTurk Requester API☆16Apr 6, 2024Updated 2 years ago
- A curated collection of awesome applications and tools that utilize large language models (LLMs) with retrieval-augmented generation (RAG…☆17Dec 25, 2025Updated 5 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆86Oct 29, 2024Updated last year
- Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.☆325Jul 10, 2025Updated 10 months ago
- End-to-End Ontology Learning with Large Language Models, NeurIPS 2024.☆54Nov 6, 2024Updated last year
- Python wrapper for https://www.getdrip.com/☆13Dec 8, 2022Updated 3 years ago
- Word embeddings learned from 10-K documents☆12Nov 6, 2019Updated 6 years ago
- openperplex is an opensource AI search engine☆895Aug 4, 2024Updated last year
- Implementation of our paper "Towards Consistent Document-Level Entity Linking: Joint Models for Entity Linking and Coreference Resolution…☆12Nov 13, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- BioContextAI Knowledgebase MCP server for biomedical agentic AI☆23Jan 12, 2026Updated 4 months ago
- The code implementation of Symbolic-MoE☆46Sep 2, 2025Updated 8 months ago
- ☆23Sep 19, 2024Updated last year
- some jsPsych demos using jspsychr☆18Nov 13, 2019Updated 6 years ago
- This project implements a Retrieval-Augmented Generation (RAG) system that can handle different types of files. The system uses FastAPI f…☆33May 29, 2025Updated 11 months ago
- Lightweight tools for quick and easy LLM demo's☆28Sep 22, 2024Updated last year
- 🤗 Benchmark Large Language Models Reliably On Your Data☆445Apr 2, 2026Updated last month
- A platform for building configurable, database-backed generative AI agentic assistants.☆25Feb 11, 2025Updated last year
- ☆122Apr 19, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Generic build server☆65May 25, 2014Updated 12 years ago
- Detecting Fraud in Online Surveys by Tracing, Scoring, and Visualizing IP Addresses☆23Aug 28, 2024Updated last year
- AWM: Agent Workflow Memory☆430Dec 22, 2025Updated 5 months ago
- Codebase for EnterpriseOps-Gym from ServiceNow☆91May 8, 2026Updated 2 weeks ago
- Just little bits.☆10Aug 5, 2025Updated 9 months ago
- ☆14Mar 10, 2026Updated 2 months ago
- LLM Building Blocks for Python Course☆17Nov 17, 2025Updated 6 months ago
- An MCP server for managing `.clinerules` files using shared components and persona templates.☆23Jan 7, 2025Updated last year
- A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data☆1,532May 20, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Clarion port of cJSON parser☆19Feb 13, 2026Updated 3 months ago
- AI data scientist☆273Dec 25, 2024Updated last year
- A merged read deduplication tool capable to perform merged read deduplication on single end data.☆13Sep 4, 2024Updated last year
- Repo for the testing-genai workshop☆14May 8, 2025Updated last year
- snowdev: A DevOps toolkit for streamlined Snowflake deployments via Snowpark☆12Sep 24, 2023Updated 2 years ago
- Build production-ready AI agents in both Python and Typescript.☆3,265May 13, 2026Updated last week
- Gradient Boosting Models on Real-Time Sensor Data for AI-Enhanced Vehicle Predictive Maintenance. By using a web-based interface to forec…☆19Nov 17, 2024Updated last year