Alternatives and similar repositories for benchmark

Users that are interested in benchmark are comparing it to the libraries listed below

• mitdbg / palimpzest
  A System for Optimized Semantic Computation
  ☆115Updated last week
• awslabs / unified-text2sql-benchmark
  UNITE: A Unified Benchmark for Text-to-SQL Evaluation
  ☆77Updated 3 weeks ago
• itrummer / CodexDB
  CodexDB generates code for SQL query processing via OpenAI's GPT-3 Codex model.
  ☆102Updated 7 months ago
• dais-polymtl / flockmtl
  FlockMTL: DuckDB extension to seamlessly combine analytics and semantic analysis using language models (LMs)
  ☆228Updated last week
• guestrin-lab / ACORN
  state-of-the-art search over vector embeddings and structured data (SIGMOD '24)
  ☆79Updated 3 months ago
• MohammadrezaPourreza / Few-shot-NL2SQL-with-prompting
  ☆367Updated last year
• qdrant / vector-db-benchmark
  Framework for benchmarking vector search engines
  ☆325Updated this week
• DAMO-NLP-SG / LLM-R2
  ☆47Updated 7 months ago
• RUCKBReasoning / text2sql-demo
  This project provides a demo for text-to-SQL based on CodeS.
  ☆53Updated last year
• HazyResearch / fm_data_tasks
  Foundation Models for Data Tasks
  ☆106Updated 2 years ago
• taoyds / test-suite-sql-eval
  Semantic Evaluation for Text-to-SQL with Distilled Test Suites
  ☆278Updated last year
• BugMaker-Boyan / NL2SQL360
  Please visit https://github.com/HKUSTDial/NL2SQL360 to get the official code!
  ☆10Updated 9 months ago
• superctj / observatory
  Characterization of relational table embeddings (VLDB 2024).
  ☆30Updated 11 months ago
• Cocoon-Data-Transformation / cocoon
  Data management with LLMs
  ☆160Updated 5 months ago
• bird-bench / bird-bench.github.io
  ☆17Updated this week
• stanford-oval / suql
  SUQL: Conversational Search over Structured and Unstructured Data with LLMs
  ☆270Updated 3 weeks ago
• itrummer / dbbert
  DB-BERT tunes database systems for optimal performance, using tuning hints mined from text.
  ☆61Updated last year
• peterbaile / beaver
  🦫 BEAVER: An Enterprise Benchmark for Text-to-SQL
  ☆17Updated last month
• dangkhoasdc / awesome-vector-database
  A curated list of awesome works related to high dimensional structure/vector search & database
  ☆288Updated 3 weeks ago
• weAIDB / awesome-data-llm
  Official Repository of "LLM × DATA" Survey Paper
  ☆342Updated last week
• ddkang / aidb
  ☆30Updated 5 months ago
• tiannuo-yang / VDTuner
  [ICDE 2024] VDTuner - Automated Performance Tuning for Vector Data Management Systems (Vector Databases)
  ☆28Updated last year
• datadotworld / cwd-benchmark-data
  Data for the Chat With Your Data benchmark.
  ☆139Updated last year
• madelonhulsebos / neural-table-representations-tutorial-2023
  Repository with an overview of the tutorial on Models and Practice of Neural Table Representations and up to date material for the hands-…
  ☆20Updated last year
• BeachWang / DAIL-SQL
  A efficient and effective few-shot NL2SQL method on GPT-4.
  ☆552Updated 3 months ago
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆131Updated last month
• NumbersStationAI / meadow
  Framework for building data agent workflows
  ☆82Updated 10 months ago
• microsoft / MSVBASE
  MSVBASE is a system that efficiently supports complex queries of both approximate similarity search and relational operators. It integrat…
  ☆94Updated 7 months ago
• facebookresearch / CRAG
  Comprehensive benchmark for RAG
  ☆194Updated last week
• defog-ai / sql-eval
  Evaluate the accuracy of LLM generated outputs
  ☆676Updated last month