apache / arrowLinks
Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
☆15,579Updated this week
Alternatives and similar repositories for arrow
Users that are interested in arrow are comparing it to the libraries listed below
Sorting:
- Apache DataFusion SQL Query Engine☆7,346Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆3,779Updated this week
- DuckDB is an analytical in-process SQL database management system☆30,314Updated this week
- Apache Parquet Java☆2,845Updated last week
- the portable Python dataframe library☆5,849Updated this week
- Parallel computing with task scheduling☆13,277Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆40,585Updated this week
- Apache Parquet Format☆1,967Updated this week
- High-performance runtime for data analytics applications☆3,004Updated 2 years ago
- Stream processing and management platform.☆7,889Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,088Updated this week
- Apache Iceberg☆7,584Updated this week
- An orchestration platform for the development, production, and observation of data assets.☆13,408Updated this week
- Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.☆6,023Updated this week
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆37,558Updated this week
- Apache Beam is a unified programming model for Batch and Streaming data processing.☆8,159Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆2,827Updated this week
- HeavyDB (formerly MapD/OmniSciDB)☆3,011Updated this week
- ZetaSQL - Analyzer Framework for SQL☆2,403Updated 2 months ago
- The Universal Storage Engine☆1,947Updated this week
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆4,826Updated this week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,332Updated 2 weeks ago
- 𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://data…☆8,494Updated this week
- Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!☆10,455Updated this week
- BlazingSQL is a lightweight, GPU accelerated, SQL engine for Python. Built on RAPIDS cuDF.☆1,978Updated 2 years ago
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆10,990Updated this week
- ClickHouse® is a real-time analytics database management system☆41,284Updated this week
- cuDF - GPU DataFrame Library☆8,987Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,779Updated this week
- Official Rust implementation of Apache Arrow☆2,981Updated this week