Alternatives and similar repositories for hdfs-native:

Users that are interested in hdfs-native are comparing it to the libraries listed below

• icelake-io / icelake
  Pure Rust Iceberg Implementation
  ☆164Updated 6 months ago
• arrow-udf / arrow-udf
  A User-Defined Function Framework for Apache Arrow.
  ☆86Updated this week
• apache / paimon-rust
  Apache Paimon Rust The rust implementation of Apache Paimon.
  ☆109Updated 4 months ago
• oliverdaff / iceberg-rs
  ☆33Updated 2 years ago
• datafusion-contrib / datafusion-orc
  Implementation of Apache ORC file format use Apache Arrow in-memory format
  ☆44Updated last month
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆157Updated this week
• sundy-li / strawboat
  A native storage format for apache arrow
  ☆82Updated last year
• JanKaul / iceberg-rust
  Rust implementation of Apache Iceberg with integration for Datafusion
  ☆140Updated this week
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with Python API bindings.
  ☆193Updated this week
• datafusion-contrib / datafusion-substrait
  Experimental support for serializing DataFusion plans using substrait
  ☆45Updated 2 years ago
• uwheel / uwheel
  Embeddable Aggregate Management System for Streams and Queries.
  ☆90Updated last month
• sjrusso8 / spark-connect-rs
  Apache Spark Connect Client for Rust
  ☆99Updated last week
• datafusion-contrib / sqlbench-runners
  SQLBench Runners
  ☆13Updated last year
• substrait-io / substrait-rs
  Rust crate for Substrait: Cross-Language Serialization for Relational Algebra
  ☆62Updated this week
• datafusion-contrib / datafusion-materialized-views
  Incremental view maintenance & query rewriting for materialized views in DataFusion
  ☆21Updated this week
• rewrite-bigdata-in-rust / RBIR
  A collection of RBIR projects and posts for anyone interested in joining this journey.
  ☆220Updated this week
• datafusion-contrib / datafusion-dft
  An opinionated and batteries included DataFusion implementation.
  ☆131Updated last week
• qwshen / spark-flight-connector
  A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
  ☆39Updated 4 months ago
• datafusion-contrib / datafusion-objectstore-hdfs
  HDFS based on Java implementation as a remote ObjectStore for DataFusion
  ☆10Updated last year
• datafusion-contrib / orc-rust
  Rust implementation of Apache ORC
  ☆15Updated 3 weeks ago
• datafusion-contrib / datafusion-tokomak
  Optimizer for DataFusion based on the egg framework
  ☆13Updated 2 years ago
• datafusion-contrib / ray-sql
  Distributed SQL Query Engine in Python using Ray
  ☆243Updated 4 months ago
• blaze-init / spark-blaze-extension
  Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.
  ☆11Updated 2 years ago
• Xuanwo / hdrs
  HDFS Native Client in Rust via HDFS C API libhdfs
  ☆35Updated 2 weeks ago
• datafusion-contrib / datafusion-federation
  Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.
  ☆94Updated this week
• Xuanwo / learn-data-lake-from-storage
  Learn Data Lake From Storage Layer.
  ☆45Updated 6 months ago
• tisonkun / morax
  Message queue and data streaming based on cloud native services.
  ☆102Updated 3 weeks ago
• nooberfsh / prusto
  A presto/trino client library written in rust.
  ☆40Updated last month
• datafusion-contrib / datafusion-dolomite
  Experimental DataFusion Optimizer
  ☆48Updated last year
• suraft / suraft
  Shared Unit Raft
  ☆80Updated 2 months ago