apache / arrow
Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
☆14,950Updated this week
Alternatives and similar repositories for arrow:
Users that are interested in arrow are comparing it to the libraries listed below
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆38,573Updated this week
- Apache DataFusion SQL Query Engine☆6,712Updated this week
- DuckDB is an analytical in-process SQL database management system☆26,206Updated this week
- dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build application…☆10,315Updated this week
- The official home of the Presto distributed SQL query engine for big data☆16,191Updated this week
- Dataframes powered by a multithreaded, vectorized query engine, written in Rust☆31,703Updated this week
- Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.☆5,866Updated this week
- Apache Beam is a unified programming model for Batch and Streaming data processing.☆7,982Updated this week
- Apache Parquet Java☆2,704Updated this week
- A library that provides an embeddable, persistent key-value store for fast storage.☆29,066Updated this week
- Apache Iceberg☆6,851Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆3,600Updated this week
- Apache Parquet Format☆1,870Updated 3 weeks ago
- the portable Python dataframe library☆5,490Updated this week
- An orchestration platform for the development, production, and observation of data assets.☆12,448Updated this week
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,064Updated this week
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆18,190Updated this week
- Parallel computing with task scheduling☆12,906Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆7,793Updated this week
- Data-Centric Pipelines and Data Versioning☆6,203Updated this week
- High-performance runtime for data analytics applications☆2,998Updated 2 years ago
- NumPy aware dynamic Python compiler using LLVM☆10,173Updated last week
- Distributed transactional key-value database, originally created to complement TiDB☆15,492Updated this week
- FlatBuffers: Memory Efficient Serialization Library☆23,722Updated this week
- 💫 Industrial-strength Natural Language Processing (NLP) in Python☆30,804Updated this week
- 𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://data…☆8,140Updated this week
- Open source platform for the machine learning lifecycle☆19,394Updated this week
- A modular implementation of timely dataflow in Rust☆3,355Updated this week
- lakeFS - Data version control for your data lake | Git for data☆4,537Updated this week
- Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.☆5,974Updated this week