Alternatives and similar repositories for hdfs-native

Users that are interested in hdfs-native are comparing it to the libraries listed below

• icelake-io / icelake
  Pure Rust Iceberg Implementation
  ☆163Updated 9 months ago
• arrow-udf / arrow-udf
  A User-Defined Function Framework for Apache Arrow.
  ☆89Updated this week
• oliverdaff / iceberg-rs
  ☆33Updated this week
• datafusion-contrib / datafusion-orc
  Implementation of Apache ORC file format use Apache Arrow in-memory format
  ☆42Updated 4 months ago
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆191Updated last month
• apache / paimon-rust
  Apache Paimon Rust The rust implementation of Apache Paimon.
  ☆122Updated 3 weeks ago
• datafusion-contrib / datafusion-substrait
  Experimental support for serializing DataFusion plans using substrait
  ☆45Updated 2 years ago
• sundy-li / strawboat
  A native storage format for apache arrow
  ☆82Updated last year
• uwheel / uwheel
  Embeddable Aggregate Management System for Streams and Queries.
  ☆90Updated 3 weeks ago
• clflushopt / tpchgen-rs
  TPC-H benchmark data generation in pure Rust
  ☆67Updated 2 weeks ago
• tisonkun / morax
  Message queue and data streaming based on cloud native services.
  ☆110Updated 3 weeks ago
• datafusion-contrib / datafusion-objectstore-hdfs
  HDFS based on Java implementation as a remote ObjectStore for DataFusion
  ☆10Updated last year
• substrait-io / substrait-rs
  Rust crate for Substrait: Cross-Language Serialization for Relational Algebra
  ☆67Updated this week
• zuston / riffle
  Rust based high-performance Apache Uniffle shuffle-server
  ☆29Updated this week
• datafusion-contrib / datafusion-table-providers
  DataFusion TableProviders for reading data from other systems
  ☆112Updated last week
• sjrusso8 / spark-connect-rs
  Apache Spark Connect Client for Rust
  ☆107Updated 2 weeks ago
• datafusion-contrib / orc-rust
  Rust implementation of Apache ORC
  ☆20Updated last month
• datafusion-contrib / datafusion-dft
  Batteries included CLI, TUI, and server implementations for DataFusion.
  ☆153Updated this week
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with Python API bindings.
  ☆211Updated last week
• Xuanwo / hdrs
  HDFS Native Client in Rust via HDFS C API libhdfs
  ☆37Updated 3 months ago
• JanKaul / iceberg-rust
  Rust implementation of Apache Iceberg with integration for Datafusion
  ☆177Updated this week
• nooberfsh / prusto
  A presto/trino client library written in rust.
  ☆42Updated 4 months ago
• rewrite-bigdata-in-rust / RBIR
  A collection of RBIR projects and posts for anyone interested in joining this journey.
  ☆240Updated this week
• qwshen / spark-flight-connector
  A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
  ☆39Updated 7 months ago
• databendlabs / bendsql
  Databend Native Client
  ☆57Updated this week
• datafusion-contrib / datafusion-dolomite
  Experimental DataFusion Optimizer
  ☆47Updated last year
• datafusion-contrib / datafusion-functions-json
  JSON support for DataFusion (unofficial)
  ☆40Updated 2 weeks ago
• datafusion-contrib / sqlbench-runners
  SQLBench Runners
  ☆13Updated last year
• datafusion-contrib / datafusion-federation
  Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.
  ☆127Updated 2 weeks ago
• datafusion-contrib / datafusion-tokomak
  Optimizer for DataFusion based on the egg framework
  ☆14Updated 3 years ago