Alternatives and similar repositories for benchmark

Users that are interested in benchmark are comparing it to the libraries listed below

• mitdbg / palimpzest
  A System for Optimized Semantic Computation
  ☆113Updated last week
• awslabs / unified-text2sql-benchmark
  UNITE: A Unified Benchmark for Text-to-SQL Evaluation
  ☆75Updated last week
• dais-polymtl / flockmtl
  FlockMTL: DuckDB extension to seamlessly combine analytics and semantic analysis using language models (LMs)
  ☆220Updated 2 weeks ago
• NumbersStationAI / NSQL
  Numbers Station Text to SQL model code.
  ☆248Updated last year
• stanford-oval / suql
  SUQL: Conversational Search over Structured and Unstructured Data with LLMs
  ☆268Updated 2 months ago
• NumbersStationAI / meadow
  Framework for building data agent workflows
  ☆82Updated 9 months ago
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆131Updated last month
• defog-ai / sql-eval
  Evaluate the accuracy of LLM generated outputs
  ☆663Updated 3 weeks ago
• qdrant / vector-db-benchmark
  Framework for benchmarking vector search engines
  ☆320Updated this week
• qdrant / ann-filtering-benchmark-datasets
  Collection of datasets for benchmarking filtered vector similarity retrieval
  ☆43Updated this week
• madelonhulsebos / gittables
  Code for extracting, parsing and annotating tables from GitTables (https://gittables.github.io).
  ☆44Updated 3 years ago
• itrummer / CodexDB
  CodexDB generates code for SQL query processing via OpenAI's GPT-3 Codex model.
  ☆103Updated 6 months ago
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆599Updated 2 months ago
• castorini / rank_llm
  RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.
  ☆457Updated this week
• zilliztech / VectorDBBench
  Benchmark designed to evaluate the performance and cost-effectiveness of vector databases.
  ☆736Updated 2 weeks ago
• mixedbread-ai / baguetter
  Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…
  ☆179Updated 9 months ago
• lotus-data / lotus
  LOTUS: A semantic query engine for fast and easy LLM-powered data processing
  ☆1,186Updated last week
• superctj / observatory
  Characterization of relational table embeddings (VLDB 2024).
  ☆30Updated 11 months ago
• guestrin-lab / ACORN
  state-of-the-art search over vector embeddings and structured data (SIGMOD '24)
  ☆79Updated 3 months ago
• bird-bench / mini_dev
  ☆80Updated last month
• JoinBoost / JoinBoost
  Train Gradient Boosting and Random Forest with only SQL (VLDB 2023)
  ☆23Updated last year
• HazyResearch / fm_data_tasks
  Foundation Models for Data Tasks
  ☆106Updated 2 years ago
• quotient-ai / judges
  A small library of LLM judges
  ☆205Updated 2 weeks ago
• Cocoon-Data-Transformation / cocoon
  Data management with LLMs
  ☆155Updated 4 months ago
• HazyResearch / evaporate
  This repo contains data and code for the paper "Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Da…
  ☆489Updated last year
• TAG-Research / TAG-Bench
  TAG-Bench: A benchmark for table-augmented generation (TAG)
  ☆739Updated 2 months ago
• MohammadrezaPourreza / Few-shot-NL2SQL-with-prompting
  ☆367Updated last year
• madelonhulsebos / neural-table-representations-tutorial-2023
  Repository with an overview of the tutorial on Models and Practice of Neural Table Representations and up to date material for the hands-…
  ☆20Updated last year
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆423Updated last year
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆132Updated last month