Alternatives and similar repositories for evalbench

Users that are interested in evalbench are comparing it to the libraries listed below

• jjovalle99 / DSPy-Text2SQL
  DSPY on action with OpenSource LLMs.
  ☆102Updated last year
• bird-bench / mini_dev
  ☆127Updated last month
• tshu-w / DBCopilot
  Code and data for the paper "DBCᴏᴘɪʟᴏᴛ: Natural Language Querying over Massive Database via Schema Routing" (EDBT 2025)
  ☆127Updated 3 months ago
• dbt-labs / semantic-layer-llm-benchmarking
  ☆44Updated 3 weeks ago
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆138Updated 3 months ago
• awslabs / unified-text2sql-benchmark
  UNITE: A Unified Benchmark for Text-to-SQL Evaluation
  ☆82Updated 6 months ago
• stanford-oval / suql
  SUQL: Conversational Search over Structured and Unstructured Data with LLMs
  ☆291Updated last month
• Cocoon-Data-Transformation / cocoon
  Data management with LLMs
  ☆176Updated 10 months ago
• apple / ml-superposition-prompting
  ☆146Updated last year
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆252Updated 9 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆56Updated last year
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆115Updated 8 months ago
• qdrant / qdrant-rag-eval
  This repo is the central repo for all the RAG Evaluation reference material and partner workshop
  ☆77Updated 7 months ago
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆126Updated last month
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆179Updated last year
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆114Updated last year
• yai333 / Text-to-SQL-GRPO-Fine-tuning-Pipeline
  This repository contains a pipeline for fine-tuning Large Language Models (LLMs) for Text-to-SQL conversion using General Reward Proximal…
  ☆39Updated 7 months ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆124Updated last month
• mixedbread-ai / baguetter
  Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…
  ☆199Updated last year
• ibm-self-serve-assets / QueryCraft
  The easiest and most comprehensive framework for building enterprise-grade NL2SQL solutions at scale.
  ☆45Updated 11 months ago
• parkervg / blendsql
  Query language for blending SQL and LLMs across structured + unstructured data, with type constraints.
  ☆121Updated this week
• hyintell / RetrievalQA
  Source code of the paper: RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering [F…
  ☆69Updated last year
• kuzudb / baml-kuzu-demo
  Demo of knowledge graph creation and Graph RAG with BAML and Kuzu
  ☆73Updated 2 months ago
• whyhow-ai / whyhow
  Automated knowledge graph creation SDK
  ☆122Updated last year
• patronus-ai / financebench
  ☆228Updated last year
• flowaicom / flow-judge
  Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…
  ☆78Updated last year
• run-llama / awesome-rag
  ☆75Updated last year
• docugami / KG-RAG-datasets
  Knowledge Graph Retrieval Augmented Generation (KG-RAG) Eval Datasets
  ☆190Updated last year
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆302Updated 6 months ago
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆49Updated last year