facebookincubator / nimbleLinks
New file format for storage of large columnar datasets.
☆577Updated this week
Alternatives and similar repositories for nimble
Users that are interested in nimble are comparing it to the libraries listed below
Sorting:
- BtrBlocks: Efficient Columnar Compression for Data Lakes (SIGMOD 2023 Paper)☆251Updated 3 months ago
- Next-Gen Big Data File Format☆394Updated this week
- Apache DataFusion Ray☆214Updated 3 months ago
- Apache DataFusion Comet Spark Accelerator☆1,007Updated last week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,362Updated last month
- Distributed SQL Query Engine in Python using Ray☆244Updated 9 months ago
- An extensible, state of the art columnar file format. Formerly at @spiraldb, now a Linux Foundation project.☆1,364Updated this week
- ☆297Updated last week
- A native Delta implementation for integration with any query engine☆238Updated this week
- Database connectivity API standard and libraries for Apache Arrow☆476Updated this week
- The Control Plane for Apache Iceberg.☆301Updated last week
- A portable Pythonic Data Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to …☆233Updated this week
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆262Updated this week
- Serverless HTAP cloud data platform powered by Arrow × DuckDB × Iceberg☆330Updated 2 years ago
- Lakekeeper is an Apache-Licensed, secure, fast and easy to use Apache Iceberg REST Catalog written in Rust.☆818Updated this week
- GlareDB: A light and fast SQL database for analytics☆951Updated last week
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆239Updated last week
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆207Updated this week
- ClickBench: a Benchmark For Analytical Databases☆853Updated this week
- Redset is a dataset containing three months worth of user query metadata that ran on a selected sample of instances in the Amazon Redshif…☆63Updated 10 months ago
- An example Flight SQL Server implementation - with DuckDB and SQLite back-ends.☆264Updated 10 months ago
- Apache Iceberg☆1,043Updated this week
- LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.☆858Updated this week
- TPC-H benchmark data generation in pure Rust☆118Updated this week
- Embeddable stream processing engine based on Apache DataFusion☆344Updated 7 months ago
- CMU-DB's Cascades optimizer framework☆402Updated 6 months ago
- Distributed pushdown cache for DataFusion☆216Updated last week
- Template for DuckDB extensions to help you develop, test and deploy a custom extension☆211Updated last week
- This is the companion repository for the book How Query Engines Work.☆396Updated 2 years ago
- Apache DataFusion Python Bindings☆480Updated this week