Alternatives and similar repositories for benchmark

Users that are interested in benchmark are comparing it to the libraries listed below

• mitdbg / palimpzest
  A System for Optimized Semantic Computation
  ☆118Updated last week
• awslabs / unified-text2sql-benchmark
  UNITE: A Unified Benchmark for Text-to-SQL Evaluation
  ☆78Updated last month
• defog-ai / sql-eval
  Evaluate the accuracy of LLM generated outputs
  ☆685Updated 2 months ago
• lotus-data / lotus
  LOTUS: A semantic query engine for fast and easy LLM-powered data processing
  ☆1,240Updated this week
• dais-polymtl / flockmtl
  FlockMTL: DuckDB extension for multimodal querying using language models (LMs) and retrieval augmented generation (RAG)
  ☆237Updated this week
• MohammadrezaPourreza / Few-shot-NL2SQL-with-prompting
  ☆369Updated last year
• bird-bench / mini_dev
  ☆91Updated last week
• zilliztech / VectorDBBench
  Benchmark designed to evaluate the performance and cost-effectiveness of vector databases.
  ☆788Updated this week
• stanford-oval / suql
  SUQL: Conversational Search over Structured and Unstructured Data with LLMs
  ☆271Updated last month
• itrummer / CodexDB
  CodexDB generates code for SQL query processing via OpenAI's GPT-3 Codex model.
  ☆102Updated 7 months ago
• NumbersStationAI / NSQL
  Numbers Station Text to SQL model code.
  ☆247Updated last year
• TAG-Research / TAG-Bench
  TAG-Bench: A benchmark for table-augmented generation (TAG)
  ☆748Updated 3 months ago
• Cocoon-Data-Transformation / cocoon
  Data management with LLMs
  ☆164Updated 5 months ago
• TsinghuaDatabaseGroup / DB-GPT
  An LLM Based Diagnosis System (https://arxiv.org/pdf/2312.01454.pdf)
  ☆651Updated 4 months ago
• weAIDB / awesome-data-llm
  Official Repository of "LLM × DATA" Survey Paper
  ☆384Updated this week
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆624Updated 3 months ago
• qdrant / vector-db-benchmark
  Framework for benchmarking vector search engines
  ☆327Updated last week
• taoyds / test-suite-sql-eval
  Semantic Evaluation for Text-to-SQL with Distilled Test Suites
  ☆283Updated last year
• ddkang / aidb
  ☆30Updated 6 months ago
• ShayanTalaei / CHESS
  Contextual Harnessing for Efficient SQL Synthesis
  ☆224Updated last month
• NumbersStationAI / DuckDB-NSQL
  DuckDB NSQL Model
  ☆305Updated 9 months ago
• guestrin-lab / ACORN
  state-of-the-art search over vector embeddings and structured data (SIGMOD '24)
  ☆79Updated 4 months ago
• ray-project / deltacat
  A portable Pythonic Data Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to …
  ☆230Updated last week
• THU-BPM / chatgpt-sql
  The prediction results of ChatGPT on various datasets of Text-to-SQL.
  ☆102Updated 2 years ago
• aryn-ai / sycamore
  🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.
  ☆536Updated this week
• microsoft / MSVBASE
  MSVBASE is a system that efficiently supports complex queries of both approximate similarity search and relational operators. It integrat…
  ☆97Updated 7 months ago
• klahnakoski / mo-sql-parsing
  Let's make a SQL parser so we can provide a familiar interface to non-sql datastores!
  ☆284Updated 5 months ago
• dangkhoasdc / awesome-vector-database
  A curated list of awesome works related to high dimensional structure/vector search & database
  ☆296Updated last month
• superctj / observatory
  Characterization of relational table embeddings (VLDB 2024).
  ☆30Updated last year
• IntelLabs / Auto-Steer
  Auto-Steer
  ☆48Updated 7 months ago