apache / arrow
Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
☆15,129Updated this week
Alternatives and similar repositories for arrow:
Users that are interested in arrow are comparing it to the libraries listed below
- High-performance runtime for data analytics applications☆2,996Updated 2 years ago
- Apache Pinot - A realtime distributed OLAP datastore☆5,681Updated this week
- Apache DataFusion SQL Query Engine☆6,909Updated this week
- Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.☆5,904Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆3,660Updated this week
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆4,281Updated this week
- NoSQL data store using the Seastar framework, compatible with Apache Cassandra and Amazon DynamoDB☆14,214Updated this week
- DuckDB is an analytical in-process SQL database management system☆27,759Updated this week
- the portable Python dataframe library☆5,608Updated this week
- Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!☆10,117Updated this week
- BlazingSQL is a lightweight, GPU accelerated, SQL engine for Python. Built on RAPIDS cuDF.☆1,954Updated 2 years ago
- Stream processing and management platform.☆7,555Updated this week
- lakeFS - Data version control for your data lake | Git for data☆4,586Updated this week
- The Open Source Feature Store for AI/ML☆5,874Updated this week
- Apache Beam is a unified programming model for Batch and Streaming data processing.☆8,044Updated this week
- Dataframes powered by a multithreaded, vectorized query engine, written in Rust☆32,499Updated this week
- Parallel computing with task scheduling☆13,045Updated this week
- 𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://data…☆8,266Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆39,217Updated this week
- FoundationDB - the open source, distributed, transactional key-value store☆15,014Updated this week
- cuDF - GPU DataFrame Library☆8,776Updated this week
- The official home of the Presto distributed SQL query engine for big data☆16,275Updated this week
- HeavyDB (formerly OmniSciDB)☆2,975Updated 6 months ago
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,175Updated last month
- CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placemen…☆30,619Updated this week
- Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)☆10,998Updated this week
- YugabyteDB - the cloud native distributed SQL database for mission-critical applications.☆9,347Updated this week
- Alluxio, data orchestration for analytics and machine learning in the cloud☆6,956Updated last month
- A library that provides an embeddable, persistent key-value store for fast storage.☆29,322Updated this week
- Apache Spark - A unified analytics engine for large-scale data processing☆40,761Updated this week