Alternatives and similar repositories for hdfs-native

Users that are interested in hdfs-native are comparing it to the libraries listed below

• icelake-io / icelake
  Pure Rust Iceberg Implementation
  ☆162Updated last year
• apache / paimon-rust
  Apache Paimon Rust The rust implementation of Apache Paimon.
  ☆130Updated 5 months ago
• oliverdaff / iceberg-rs
  ☆33Updated 4 months ago
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with C++ & Python API bindings.
  ☆254Updated this week
• arrow-udf / arrow-udf
  A User-Defined Function Framework for Apache Arrow.
  ☆104Updated last month
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆221Updated 2 months ago
• rewrite-bigdata-in-rust / RBIR
  A collection of RBIR projects and posts for anyone interested in joining this journey.
  ☆291Updated this week
• datafusion-contrib / datafusion-orc
  Implementation of Apache ORC file format use Apache Arrow in-memory format
  ☆44Updated 9 months ago
• clflushopt / tpchgen-rs
  TPC-H benchmark data generation in pure Rust
  ☆183Updated 3 weeks ago
• datafusion-contrib / datafusion-table-providers
  DataFusion TableProviders for reading data from other systems
  ☆149Updated this week
• datafusion-contrib / orc-rust
  Rust implementation of Apache ORC
  ☆25Updated this week
• JanKaul / iceberg-rust
  Unofficial rust implementation of Apache Iceberg with integration for Datafusion
  ☆217Updated last week
• Xuanwo / hdrs
  HDFS Native Client in Rust via HDFS C API libhdfs
  ☆39Updated 8 months ago
• tisonkun / morax
  Message queue and data streaming based on cloud native services.
  ☆115Updated 5 months ago
• qwshen / spark-flight-connector
  A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
  ☆43Updated last year
• datafusion-contrib / datafusion-materialized-views
  Incremental view maintenance & query rewriting for materialized views in DataFusion
  ☆48Updated last week
• zuston / riffle
  Rust based high-performance Apache Uniffle shuffle-server
  ☆42Updated last week
• datafusion-contrib / datafusion-federation
  Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.
  ☆149Updated 2 weeks ago
• CurvineIO / curvine
  High performance distributed cache system. Built by Rust.
  ☆354Updated last week
• sjrusso8 / spark-connect-rs
  Apache Spark Connect Client for Rust
  ☆113Updated 3 months ago
• datafusion-contrib / datafusion-substrait
  Experimental support for serializing DataFusion plans using substrait
  ☆46Updated 2 years ago
• datafusion-contrib / ray-sql
  Distributed SQL Query Engine in Python using Ray
  ☆246Updated last year
• sundy-li / strawboat
  A native storage format for apache arrow
  ☆82Updated last year
• datafusion-contrib / datafusion-dft
  Batteries included CLI, TUI, and server implementations for DataFusion.
  ☆165Updated 3 months ago
• uwheel / uwheel
  Embeddable Aggregate Management System for Streams and Queries.
  ☆96Updated 5 months ago
• XiangpengHao / liquid-cache
  Distributed pushdown cache for DataFusion
  ☆284Updated last week
• substrait-io / substrait-rs
  Rust crate for Substrait: Cross-Language Serialization for Relational Algebra
  ☆77Updated last week
• nimtable / iceberg-compaction
  Compaction runtime for Apache Iceberg.
  ☆87Updated last week
• datafusion-contrib / datafusion-dolomite
  Experimental DataFusion Optimizer
  ☆50Updated 2 years ago
• datafusion-contrib / datafusion-objectstore-hdfs
  HDFS based on Java implementation as a remote ObjectStore for DataFusion
  ☆10Updated last year