Alternatives and similar repositories for benchmark:

Users that are interested in benchmark are comparing it to the libraries listed below

• awslabs / unified-text2sql-benchmark
  UNITE: A Unified Benchmark for Text-to-SQL Evaluation
  ☆70Updated 10 months ago
• mitdbg / palimpzest
  A System for (Optimized) Semantic Computation
  ☆92Updated this week
• NumbersStationAI / meadow
  Framework for building data agent workflows
  ☆83Updated 7 months ago
• guestrin-lab / ACORN
  state-of-the-art search over vector embeddings and structured data (SIGMOD '24)
  ☆70Updated 3 weeks ago
• defog-ai / sql-eval
  Evaluate the accuracy of LLM generated outputs
  ☆644Updated last month
• peterbaile / beaver
  🦫 BEAVER: An Enterprise Benchmark for Text-to-SQL
  ☆14Updated last month
• MohammadrezaPourreza / Few-shot-NL2SQL-with-prompting
  ☆357Updated last year
• bird-bench / mini_dev
  ☆64Updated 5 months ago
• NumbersStationAI / NSQL
  Numbers Station Text to SQL model code.
  ☆246Updated last year
• quge2023 / TA-SQL
  ☆42Updated 4 months ago
• TAG-Research / TAG-Bench
  TAG-Bench: A benchmark for table-augmented generation (TAG)
  ☆712Updated last week
• RUCKBReasoning / text2sql-demo
  This project provides a demo for text-to-SQL based on CodeS.
  ☆52Updated 9 months ago
• dsg-polymtl / flockmtl
  FlockMTL: DuckDB extension to seamlessly combine analytics and semantic analysis using language models (LMs)
  ☆108Updated this week
• taoyds / test-suite-sql-eval
  Semantic Evaluation for Text-to-SQL with Distilled Test Suites
  ☆264Updated 9 months ago
• xlang-ai / Binder
  [ICLR 2023] Code for the paper "Binding Language Models in Symbolic Languages"
  ☆312Updated last year
• itrummer / CodexDB
  CodexDB generates code for SQL query processing via OpenAI's GPT-3 Codex model.
  ☆101Updated 4 months ago
• madelonhulsebos / gittables
  Code for extracting, parsing and annotating tables from GitTables (https://gittables.github.io).
  ☆43Updated 3 years ago
• BeachWang / DAIL-SQL
  A efficient and effective few-shot NL2SQL method on GPT-4.
  ☆511Updated 3 weeks ago
• tshu-w / DBCopilot
  Code and data for the paper "DBCᴏᴘɪʟᴏᴛ: Natural Language Querying over Massive Database via Schema Routing" (EDBT 2025)
  ☆88Updated 2 weeks ago
• qdrant / vector-db-benchmark
  Framework for benchmarking vector search engines
  ☆316Updated this week
• weAIDB / awsome-data-llm
  ☆143Updated last week
• AdrianBZG / LLM-distributed-finetune
  Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the …
  ☆56Updated last year
• duckdb / duckdb-vss
  ☆133Updated 2 months ago
• pixeltable / pixeltable
  Pixeltable — AI Data infrastructure providing a declarative, incremental approach for multimodal workloads.
  ☆166Updated this week
• mixedbread-ai / baguetter
  Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…
  ☆173Updated 7 months ago
• jacopotagliabue / foundation-models-for-dbt-entity-matching
  Playground for using large language models into the Modern Data Stack for entity matching
  ☆107Updated 2 years ago
• xlang-ai / Spider2
  [ICLR 2025 Oral] Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows
  ☆379Updated this week
• HazyResearch / fm_data_tasks
  Foundation Models for Data Tasks
  ☆105Updated last year
• Arize-ai / openinference
  OpenTelemetry Instrumentation for AI Observability
  ☆360Updated this week
• castorini / rank_llm
  RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.
  ☆419Updated this week