Alternatives and similar repositories for benchmark

Users that are interested in benchmark are comparing it to the libraries listed below

• mitdbg / palimpzest
  A System for Optimized Semantic Computation
  ☆192Updated this week
• defog-ai / sql-eval
  Evaluate the accuracy of LLM generated outputs
  ☆732Updated 5 months ago
• NumbersStationAI / NSQL
  Numbers Station Text to SQL model code.
  ☆254Updated 2 weeks ago
• lotus-data / lotus
  AI-Powered Data Processing: Use LOTUS to process all of your datasets with LLMs and embeddings. Enjoy up to 1000x speedups with fast, acc…
  ☆1,545Updated last week
• awslabs / unified-text2sql-benchmark
  UNITE: A Unified Benchmark for Text-to-SQL Evaluation
  ☆84Updated 8 months ago
• zilliztech / VectorDBBench
  Benchmark for vector databases.
  ☆1,004Updated last week
• itrummer / CodexDB
  CodexDB generates code for SQL query processing via OpenAI's GPT-3 Codex model.
  ☆102Updated last year
• qdrant / vector-db-benchmark
  Framework for benchmarking vector search engines
  ☆344Updated last week
• TAG-Research / TAG-Bench
  TAG-Bench: A benchmark for table-augmented generation (TAG)
  ☆766Updated 10 months ago
• dangkhoasdc / awesome-vector-database
  A curated list of awesome works related to high dimensional structure/vector search & database
  ☆328Updated 3 weeks ago
• bird-bench / mini_dev
  ☆141Updated 3 months ago
• aryn-ai / sycamore
  🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.
  ☆585Updated this week
• Cocoon-Data-Transformation / cocoon
  Data management with LLMs
  ☆182Updated last year
• MohammadrezaPourreza / Few-shot-NL2SQL-with-prompting
  ☆403Updated last year
• guestrin-lab / ACORN
  state-of-the-art search over vector embeddings and structured data (SIGMOD '24)
  ☆102Updated 11 months ago
• superctj / observatory
  Characterization of relational table embeddings (VLDB 2024).
  ☆32Updated last year
• HazyResearch / evaporate
  This repo contains data and code for the paper "Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Da…
  ☆495Updated last year
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆687Updated 10 months ago
• NumbersStationAI / DuckDB-NSQL
  DuckDB NSQL Model
  ☆332Updated 2 weeks ago
• premAI-io / premsql
  End-to-End Local-First Text-to-SQL Pipelines
  ☆435Updated 11 months ago
• NumbersStationAI / meadow
  Framework for building data agent workflows
  ☆84Updated last year
• mitdbg / Kramabench
  A repository for the Kramabench benchmark
  ☆39Updated this week
• stanford-futuredata / FrugalGPT
  FrugalGPT: better quality and lower cost for LLM applications
  ☆245Updated last year
• tshu-w / DBCopilot
  Code and data for the paper "DBCᴏᴘɪʟᴏᴛ: Natural Language Querying over Massive Database via Schema Routing" (EDBT 2025)
  ☆134Updated 5 months ago
• Snowflake-Labs / snowflake-arctic
  ☆559Updated last year
• stanford-oval / suql
  SUQL: Conversational Search over Structured and Unstructured Data with LLMs
  ☆298Updated 3 weeks ago
• dais-polymtl / flock
  Flock: multimodal querying for DuckDB
  ☆291Updated 2 weeks ago
• BugMaker-Boyan / NL2SQL360
  Please visit https://github.com/HKUSTDial/NL2SQL360 to get the official code!
  ☆10Updated last year
• taoyds / test-suite-sql-eval
  Semantic Evaluation for Text-to-SQL with Distilled Test Suites
  ☆313Updated last year
• superlinked / VectorHub
  VectorHub is a free, open-source learning website for people (software developers to senior ML architects) interested in adding vector re…
  ☆511Updated last week