Alternatives and similar repositories for hdfs-native

Users that are interested in hdfs-native are comparing it to the libraries listed below

• icelake-io / icelake
  Pure Rust Iceberg Implementation
  ☆163Updated 11 months ago
• oliverdaff / iceberg-rs
  ☆33Updated 2 months ago
• arrow-udf / arrow-udf
  A User-Defined Function Framework for Apache Arrow.
  ☆100Updated this week
• apache / paimon-rust
  Apache Paimon Rust The rust implementation of Apache Paimon.
  ☆129Updated 3 months ago
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆214Updated 4 months ago
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with C++ & Python API bindings.
  ☆245Updated 2 weeks ago
• datafusion-contrib / datafusion-orc
  Implementation of Apache ORC file format use Apache Arrow in-memory format
  ☆43Updated 7 months ago
• datafusion-contrib / datafusion-dft
  Batteries included CLI, TUI, and server implementations for DataFusion.
  ☆162Updated last month
• clflushopt / tpchgen-rs
  TPC-H benchmark data generation in pure Rust
  ☆118Updated this week
• datafusion-contrib / datafusion-table-providers
  DataFusion TableProviders for reading data from other systems
  ☆135Updated this week
• datafusion-contrib / datafusion-materialized-views
  Incremental view maintenance & query rewriting for materialized views in DataFusion
  ☆41Updated this week
• sjrusso8 / spark-connect-rs
  Apache Spark Connect Client for Rust
  ☆111Updated last month
• JanKaul / iceberg-rust
  Unofficial rust implementation of Apache Iceberg with integration for Datafusion
  ☆207Updated last week
• uwheel / uwheel
  Embeddable Aggregate Management System for Streams and Queries.
  ☆94Updated 3 months ago
• datafusion-contrib / datafusion-substrait
  Experimental support for serializing DataFusion plans using substrait
  ☆45Updated 2 years ago
• rewrite-bigdata-in-rust / RBIR
  A collection of RBIR projects and posts for anyone interested in joining this journey.
  ☆273Updated this week
• substrait-io / substrait-rs
  Rust crate for Substrait: Cross-Language Serialization for Relational Algebra
  ☆73Updated this week
• datafusion-contrib / ray-sql
  Distributed SQL Query Engine in Python using Ray
  ☆244Updated 10 months ago
• Xuanwo / hdrs
  HDFS Native Client in Rust via HDFS C API libhdfs
  ☆39Updated 6 months ago
• datafusion-contrib / datafusion-federation
  Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.
  ☆139Updated last week
• tisonkun / morax
  Message queue and data streaming based on cloud native services.
  ☆113Updated 3 months ago
• cda-group / arcon
  State-first Streaming Applications in Rust
  ☆175Updated 2 years ago
• datafusion-contrib / datafusion-functions-json
  JSON support for DataFusion (unofficial)
  ☆45Updated last week
• datafusion-contrib / sqlbench-runners
  SQLBench Runners
  ☆13Updated last year
• delta-io / delta-kernel-rs
  A native Delta implementation for integration with any query engine
  ☆238Updated this week
• qwshen / spark-flight-connector
  A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
  ☆42Updated 10 months ago
• datafusion-contrib / orc-rust
  Rust implementation of Apache ORC
  ☆20Updated 4 months ago
• jorgecarleitao / parquet2
  Fastest and safest Rust implementation of parquet. `unsafe` free. Integration-tested against pyarrow
  ☆362Updated last year
• nimtable / iceberg-compaction
  Comptaction runtime for Apache Iceberg.
  ☆58Updated last week
• sundy-li / strawboat
  A native storage format for apache arrow
  ☆82Updated last year