Alternatives and similar repositories for arrow

Users that are interested in arrow are comparing it to the libraries listed below

• apache / datafusion
  Apache DataFusion SQL Query Engine
  ☆7,436Updated this week
• MaterializeInc / materialize
  Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.
  ☆6,040Updated this week
• facebookincubator / velox
  A composable and fully extensible C++ execution engine library for data management systems.
  ☆3,802Updated this week
• prestodb / presto
  The official home of the Presto distributed SQL query engine for big data
  ☆16,395Updated this week
• dask / dask
  Parallel computing with task scheduling
  ☆13,314Updated 2 weeks ago
• apache / pinot
  Apache Pinot - A realtime distributed OLAP datastore
  ☆5,823Updated last week
• apache / druid
  Apache Druid: a high performance real-time analytics database.
  ☆13,759Updated this week
• apache / iceberg
  Apache Iceberg
  ☆7,684Updated this week
• heavyai / heavydb
  HeavyDB (formerly MapD/OmniSciDB)
  ☆3,015Updated 3 weeks ago
• delta-io / delta
  An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…
  ☆8,125Updated last week
• databendlabs / databend
  𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://data…
  ☆8,528Updated this week
• risingwavelabs / risingwave
  Stream processing and management platform.
  ☆7,970Updated this week
• scylladb / scylladb
  NoSQL data store using the Seastar framework, compatible with Apache Cassandra and Amazon DynamoDB
  ☆14,652Updated this week
• ibis-project / ibis
  the portable Python dataframe library
  ☆5,913Updated this week
• apache / parquet-java
  Apache Parquet Java
  ☆2,872Updated last week
• lancedb / lance
  Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…
  ☆4,984Updated this week
• redpanda-data / redpanda
  Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
  ☆10,518Updated last week
• duckdb / duckdb
  DuckDB is an analytical in-process SQL database management system
  ☆30,862Updated this week
• weld-project / weld
  High-performance runtime for data analytics applications
  ☆3,006Updated 3 years ago
• Alluxio / alluxio
  Alluxio, data orchestration for analytics and machine learning in the cloud
  ☆7,028Updated 2 months ago
• trinodb / trino
  Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
  ☆11,550Updated this week
• apache / beam
  Apache Beam is a unified programming model for Batch and Streaming data processing.
  ☆8,208Updated this week
• pola-rs / polars
  Dataframes powered by a multithreaded, vectorized query engine, written in Rust
  ☆34,312Updated last week
• dagster-io / dagster
  An orchestration platform for the development, production, and observation of data assets.
  ☆13,509Updated this week
• facebook / rocksdb
  A library that provides an embeddable, persistent key-value store for fast storage.
  ☆30,047Updated this week
• BlazingDB / blazingsql
  BlazingSQL is a lightweight, GPU accelerated, SQL engine for Python. Built on RAPIDS cuDF.
  ☆1,980Updated 2 years ago
• apache / airflow
  Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
  ☆40,947Updated this week
• numba / numba
  NumPy aware dynamic Python compiler using LLVM
  ☆10,500Updated last week
• apache / pulsar
  Apache Pulsar - distributed pub-sub messaging system
  ☆14,713Updated this week
• PrefectHQ / prefect
  Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
  ☆19,754Updated this week