Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation
☆108Dec 16, 2024Updated last year
Alternatives and similar repositories for autoarena
Users that are interested in autoarena are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The first AI agent with *agency*☆36Apr 5, 2026Updated last week
- ☆12Aug 17, 2024Updated last year
- ☆23Oct 28, 2024Updated last year
- ☆14Oct 6, 2025Updated 6 months ago
- ☆18May 28, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Leveraging Base Language Models for Few-Shot Synthetic Data Generation☆41Oct 18, 2025Updated 5 months ago
- Using Pinecone, LangChain + OpenAI for Generative Q&A with Retrieval Augmented Generation (RAG).☆16Aug 9, 2023Updated 2 years ago
- A curated collection of awesome applications and tools that utilize large language models (LLMs) with retrieval-augmented generation (RAG…☆17Dec 25, 2025Updated 3 months ago
- Generate MANY nfts, become rich and retire at the age of 5.☆14Mar 8, 2022Updated 4 years ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆85Oct 29, 2024Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆181May 2, 2024Updated last year
- Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.☆325Jul 10, 2025Updated 9 months ago
- Anthropic Computer Use with Modal Sandboxes☆47Oct 23, 2024Updated last year
- Content for the supergraph.io website☆17Jun 18, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Word embeddings learned from 10-K documents☆12Nov 6, 2019Updated 6 years ago
- VSCode extension for working with Architecture As A Code in the C4 model. Includes syntax highlighting, diagram preview, and tools for wo…☆35Apr 7, 2026Updated last week
- flow-merge is a powerful Python library that enables seamless merging of multiple transformer-based language models using the most popula…☆20Feb 12, 2025Updated last year
- Implementation of our paper "Towards Consistent Document-Level Entity Linking: Joint Models for Entity Linking and Coreference Resolution…☆12Nov 13, 2022Updated 3 years ago
- ☆23Sep 19, 2024Updated last year
- This project implements a Retrieval-Augmented Generation (RAG) system that can handle different types of files. The system uses FastAPI f…☆34May 29, 2025Updated 10 months ago
- 🤗 Benchmark Large Language Models Reliably On Your Data☆437Apr 2, 2026Updated last week
- SDLC Copilot is an Agentic AI system designed to streamline and automate the Software Development Lifecycle (SDLC). From requirement gath…☆23Jun 14, 2025Updated 10 months ago
- wav2lip-api☆11Mar 16, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A platform for building configurable, database-backed generative AI agentic assistants.☆25Feb 11, 2025Updated last year
- Generic build server☆65May 25, 2014Updated 11 years ago
- readthedocs.org documentation for Inkplate boards☆10Aug 25, 2025Updated 7 months ago
- Codebase for EnterpriseOps-Gym from ServiceNow☆81Mar 25, 2026Updated 2 weeks ago
- Just little bits.☆10Aug 5, 2025Updated 8 months ago
- Large Language Model (LLM) powered evaluator for Retrieval Augmented Generation (RAG) pipelines.☆40Apr 29, 2024Updated last year
- ☆14Mar 10, 2026Updated last month
- An MCP server for managing `.clinerules` files using shared components and persona templates.☆23Jan 7, 2025Updated last year
- My Portfolio of all the projects I did for both my Udacity Data Engineer and Data Streaming Nanodegrees☆21Jul 16, 2020Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data☆1,535May 20, 2025Updated 10 months ago
- AI data scientist☆274Dec 25, 2024Updated last year
- An experiment to see if chatgpt can improve the output of the stanford alpaca dataset☆12Mar 29, 2023Updated 3 years ago
- snowdev: A DevOps toolkit for streamlined Snowflake deployments via Snowpark☆12Sep 24, 2023Updated 2 years ago
- Build production-ready AI agents in both Python and Typescript.☆3,214Apr 8, 2026Updated last week
- Gradient Boosting Models on Real-Time Sensor Data for AI-Enhanced Vehicle Predictive Maintenance. By using a web-based interface to forec…☆19Nov 17, 2024Updated last year
- A sample app to debug and validate cellular modems on balena devices☆13Jun 5, 2019Updated 6 years ago