Alternatives and similar repositories for arrow

Users that are interested in arrow are comparing it to the libraries listed below

• apache / datafusion
  Apache DataFusion SQL Query Engine
  ☆7,811Updated this week
• facebookincubator / velox
  A composable and fully extensible C++ execution engine library for data management systems.
  ☆3,904Updated last week
• apache / iceberg
  Apache Iceberg
  ☆8,014Updated last week
• MaterializeInc / materialize
  Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.
  ☆6,124Updated last week
• apache / parquet-format
  Apache Parquet Format
  ☆2,055Updated last week
• delta-io / delta
  An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…
  ☆8,301Updated this week
• ibis-project / ibis
  the portable Python dataframe library
  ☆6,129Updated last week
• apache / pinot
  Apache Pinot - A realtime distributed OLAP datastore
  ☆5,909Updated this week
• apache / parquet-java
  Apache Parquet Java
  ☆2,952Updated this week
• dask / dask
  Parallel computing with task scheduling
  ☆13,509Updated last week
• pola-rs / polars
  Extremely fast Query Engine for DataFrames, written in Rust
  ☆35,506Updated this week
• apache / beam
  Apache Beam is a unified programming model for Batch and Streaming data processing.
  ☆8,307Updated this week
• weld-project / weld
  High-performance runtime for data analytics applications
  ☆3,001Updated 3 years ago
• duckdb / duckdb
  DuckDB is an analytical in-process SQL database management system
  ☆33,091Updated last week
• prestodb / presto
  The official home of the Presto distributed SQL query engine for big data
  ☆16,522Updated this week
• lancedb / lance
  Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…
  ☆5,449Updated this week
• trinodb / trino
  Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
  ☆11,984Updated this week
• heavyai / heavydb
  HeavyDB (formerly MapD/OmniSciDB)
  ☆3,030Updated 2 weeks ago
• databendlabs / databend
  𝗔𝗜-𝗡𝗮𝘁𝗶𝘃𝗲 𝗗𝗮𝘁𝗮 𝗪𝗮𝗿𝗲𝗵𝗼𝘂𝘀𝗲. Open-source Snowflake alternative. Proven at petabyte scale with enterprise performance. B…
  ☆8,892Updated this week
• pachyderm / pachyderm
  Data-Centric Pipelines and Data Versioning
  ☆6,259Updated 8 months ago
• spotify / luigi
  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…
  ☆18,514Updated 4 months ago
• risingwavelabs / risingwave
  Real-time event streaming platform. Streaming CDC, stream processing, low-latency serving, and Iceberg management.
  ☆8,396Updated last week
• apache / airflow
  Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
  ☆42,597Updated last week
• apache / hudi
  Upserts, Deletes And Incremental Processing on Big Data.
  ☆5,963Updated this week
• apache / druid
  Apache Druid: a high performance real-time analytics database.
  ☆13,833Updated this week
• Netflix / metaflow
  Build, Manage and Deploy AI/ML Systems
  ☆9,491Updated last week
• vectordotdev / vector
  A high-performance observability data pipeline.
  ☆20,422Updated this week
• TimelyDataflow / timely-dataflow
  A modular implementation of timely dataflow in Rust
  ☆3,513Updated last week
• ClickHouse / ClickHouse
  ClickHouse® is a real-time analytics database management system
  ☆43,161Updated this week
• apache / arrow-rs
  Official Rust implementation of Apache Arrow
  ☆3,142Updated this week