apache / arrow
Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
☆15,385Updated this week
Alternatives and similar repositories for arrow:
Users that are interested in arrow are comparing it to the libraries listed below
- Apache DataFusion SQL Query Engine☆7,169Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆3,727Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆7,997Updated this week
- High-performance runtime for data analytics applications☆3,000Updated 2 years ago
- Apache Parquet Format☆1,942Updated 3 weeks ago
- Apache Parquet Java☆2,803Updated this week
- Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆11,257Updated this week
- Stream processing and management platform.☆7,726Updated this week
- Distributed transactional key-value database, originally created to complement TiDB☆15,789Updated last week
- NoSQL data store using the Seastar framework, compatible with Apache Cassandra and Amazon DynamoDB☆14,474Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆39,979Updated this week
- the portable Python dataframe library☆5,731Updated this week
- Parallel computing with task scheduling☆13,177Updated this week
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆4,584Updated this week
- Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.☆5,970Updated this week
- HeavyDB (formerly OmniSciDB)☆2,994Updated 8 months ago
- Apache Iceberg☆7,334Updated this week
- Apache Pinot - A realtime distributed OLAP datastore☆5,764Updated this week
- FoundationDB - the open source, distributed, transactional key-value store☆15,144Updated this week
- A library that provides an embeddable, persistent key-value store for fast storage.☆29,643Updated this week
- A new arguably faster implementation of Apache Spark from scratch in Rust☆2,229Updated 3 years ago
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆19,230Updated this week
- ClickHouse® is a real-time analytics database management system☆40,523Updated this week
- Upserts, Deletes And Incremental Processing on Big Data.☆5,755Updated this week
- 𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://data…☆8,397Updated this week
- The official home of the Presto distributed SQL query engine for big data☆16,325Updated this week
- Official Rust implementation of Apache Arrow☆2,919Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆2,731Updated this week
- Alluxio, data orchestration for analytics and machine learning in the cloud☆6,982Updated last week
- Apache Druid: a high performance real-time analytics database.☆13,698Updated this week