Alternatives and similar repositories for arrow

Users that are interested in arrow are comparing it to the libraries listed below

• apache / datafusion
  Apache DataFusion SQL Query Engine
  ☆7,585Updated this week
• apache / parquet-format
  Apache Parquet Format
  ☆1,999Updated this week
• apache / parquet-java
  Apache Parquet Java
  ☆2,895Updated this week
• delta-io / delta
  An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…
  ☆8,183Updated this week
• ibis-project / ibis
  the portable Python dataframe library
  ☆5,971Updated this week
• duckdb / duckdb
  DuckDB is an analytical in-process SQL database management system
  ☆31,356Updated this week
• dask / dask
  Parallel computing with task scheduling
  ☆13,370Updated this week
• databendlabs / databend
  𝗔𝗜-𝗡𝗮𝘁𝗶𝘃𝗲 𝗗𝗮𝘁𝗮 𝗪𝗮𝗿𝗲𝗵𝗼𝘂𝘀𝗲. Open-source Snowflake alternative. Proven at petabyte scale with enterprise performance. B…
  ☆8,710Updated this week
• apache / iceberg
  Apache Iceberg
  ☆7,776Updated this week
• prestodb / presto
  The official home of the Presto distributed SQL query engine for big data
  ☆16,427Updated this week
• weld-project / weld
  High-performance runtime for data analytics applications
  ☆3,003Updated 3 years ago
• MaterializeInc / materialize
  Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.
  ☆6,067Updated this week
• apache / pinot
  Apache Pinot - A realtime distributed OLAP datastore
  ☆5,850Updated this week
• lancedb / lance
  Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…
  ☆5,129Updated this week
• risingwavelabs / risingwave
  Stream processing and management platform.
  ☆8,189Updated this week
• apache / druid
  Apache Druid: a high performance real-time analytics database.
  ☆13,787Updated this week
• apache / airflow
  Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
  ☆41,352Updated this week
• scylladb / scylladb
  NoSQL data store using the Seastar framework, compatible with Apache Cassandra and Amazon DynamoDB
  ☆14,724Updated this week
• ray-project / ray
  Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
  ☆38,282Updated this week
• tikv / tikv
  Distributed transactional key-value database, originally created to complement TiDB
  ☆16,026Updated this week
• pola-rs / polars
  Dataframes powered by a multithreaded, vectorized query engine, written in Rust
  ☆34,639Updated last week
• rapidsai / cudf
  cuDF - GPU DataFrame Library
  ☆9,094Updated this week
• TileDB-Inc / TileDB
  The Universal Storage Engine
  ☆1,975Updated this week
• heavyai / heavydb
  HeavyDB (formerly MapD/OmniSciDB)
  ☆3,018Updated last month
• apache / hudi
  Upserts, Deletes And Incremental Processing on Big Data.
  ☆5,895Updated this week
• facebook / rocksdb
  A library that provides an embeddable, persistent key-value store for fast storage.
  ☆30,173Updated this week
• trinodb / trino
  Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
  ☆11,661Updated this week
• BlazingDB / blazingsql
  BlazingSQL is a lightweight, GPU accelerated, SQL engine for Python. Built on RAPIDS cuDF.
  ☆1,982Updated 2 years ago
• apache / arrow-rs
  Official Rust implementation of Apache Arrow
  ☆3,076Updated this week
• pachyderm / pachyderm
  Data-Centric Pipelines and Data Versioning
  ☆6,245Updated 6 months ago