Alternatives and similar repositories for datafusion-benchmarks

Users that are interested in datafusion-benchmarks are comparing it to the libraries listed below

• clflushopt / tpchgen-rs
  TPC-H benchmark data generation in pure Rust
  ☆221Updated this week
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆228Updated 3 months ago
• substrait-io / duckdb-substrait-extension
  ☆53Updated 3 weeks ago
• qwshen / spark-flight-connector
  A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
  ☆46Updated last month
• datafusion-contrib / ray-sql
  Distributed SQL Query Engine in Python using Ray
  ☆246Updated last year
• delta-io / delta-kernel-rs
  A native Delta implementation for integration with any query engine
  ☆307Updated this week
• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆85Updated last year
• amazon-science / redset
  Redset is a dataset containing three months worth of user query metadata that ran on a selected sample of instances in the Amazon Redshif…
  ☆65Updated last year
• ibis-project / ibis-substrait
  Ibis Substrait Compiler
  ☆108Updated last week
• voltrondata / spark-substrait-gateway
  Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
  ☆20Updated 11 months ago
• rymurr / flight-spark-source
  ☆107Updated 2 years ago
• JanKaul / iceberg-rust
  Unofficial rust implementation of Apache Iceberg with integration for Datafusion
  ☆232Updated this week
• Mause / duckdb-deltatable-extension
  A purely experimental DuckDB Deltalake extension
  ☆95Updated this week
• maxi-k / btrblocks
  BtrBlocks: Efficient Columnar Compression for Data Lakes (SIGMOD 2023 Paper)
  ☆277Updated 9 months ago
• oliverdaff / iceberg-rs
  ☆33Updated 8 months ago
• apache / parquet-testing
  Apache Parquet Testing
  ☆80Updated last month
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with C++ & Python API bindings.
  ☆266Updated last week
• Embucket / embucket-labs
  Experimental version. A BYOC option for Snowflake workloads
  ☆100Updated this week
• nimtable / iceberg-compaction
  Compaction runtime for Apache Iceberg.
  ☆114Updated this week
• XiangpengHao / liquid-cache
  Distributed pushdown cache for DataFusion
  ☆360Updated this week
• icelake-io / icelake
  Pure Rust Iceberg Implementation
  ☆162Updated last year
• duckdb / duckdb-iceberg
  ☆365Updated last week
• rewrite-bigdata-in-rust / RBIR
  A collection of RBIR projects and posts for anyone interested in joining this journey.
  ☆306Updated this week
• datafusion-contrib / bdt
  Boring Data Tool
  ☆239Updated last year
• awslabs / s3-tables-catalog
  The Amazon S3 Tables catalog is a client library that bridges control plane operations provided by S3 Tables to engines like Apache Spark…
  ☆145Updated 5 months ago
• voltrondata / sqlflite
  An example Flight SQL Server implementation - with DuckDB and SQLite back-ends.
  ☆279Updated last year
• voltrondata / flight-duckdb-example
  Sample code to accompany blog post showcasing Arrow Flight SQL running on DuckDB
  ☆36Updated 3 years ago
• Ackuq / spark-pit
  Point-in-Time optimizations for Apache Spark
  ☆30Updated last year
• linkedin / Hoptimator
  Multi-hop declarative data pipelines
  ☆122Updated last week
• lakekeeper / console
  A leightweight UI for Lakekeeper
  ☆16Updated this week