facebookincubator / nimbleView external linksLinks
New file format for storage of large columnar datasets.
☆690Updated this week
Alternatives and similar repositories for nimble
Users that are interested in nimble are comparing it to the libraries listed below
Sorting:
- An extensible, state of the art columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Li…☆2,688Feb 7, 2026Updated last week
- Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data ve…☆6,042Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆4,049Feb 7, 2026Updated last week
- Apache DataFusion Comet Spark Accelerator☆1,130Feb 7, 2026Updated last week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,466Updated this week
- GlareDB: A light and fast SQL database for analytics☆998Nov 14, 2025Updated 2 months ago
- AnyBlob - A Universal Cloud Object Storage Download Manager Built For Cost-Throughput Optimal Analytics!☆145Dec 29, 2025Updated last month
- BtrBlocks: Efficient Columnar Compression for Data Lakes (SIGMOD 2023 Paper)☆279Apr 7, 2025Updated 10 months ago
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,512Updated this week
- Next-Gen Big Data File Format☆655Oct 11, 2025Updated 4 months ago
- A cloud native embedded storage engine built on object storage.☆2,704Updated this week
- Apache DataFusion SQL Query Engine☆8,371Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,968Updated this week
- Tonbo is an embedded database for serverless and edge runtimes.☆1,486Updated this week
- The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query process…☆1,708Updated this week
- Database connectivity API standard and libraries for Apache Arrow☆550Updated this week
- Apache DataFusion Ray☆229Oct 5, 2025Updated 4 months ago
- Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processin…☆1,157Feb 1, 2026Updated last week
- Apache Iceberg☆1,220Updated this week
- High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale☆5,200Updated this week
- ☆376Updated this week
- Distributed pushdown cache for DataFusion☆377Jan 25, 2026Updated 2 weeks ago
- Rust implementation of the FastLanes compression library☆161Updated this week
- Hybrid in-memory and disk cache in Rust☆1,630Updated this week
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆268Updated this week
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆1,825Updated this week
- CMU-DB's Cascades optimizer framework☆404Jan 6, 2025Updated last year
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,413Updated this week
- Lakekeeper is an Apache-Licensed, secure, fast and easy to use Apache Iceberg REST Catalog written in Rust.☆1,175Updated this week
- LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.☆1,162Updated this week
- Open, Multi-modal Catalog for Data & AI, written in Rust☆86Sep 30, 2024Updated last year
- A User-Defined Function Framework for Apache Arrow.☆111Feb 1, 2026Updated last week
- Distributed stream processing engine in Rust☆4,800Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆3,135Updated this week
- Pure-Rust implementation of Fast Static Symbol Tables string compression☆206Feb 7, 2026Updated last week
- Axiom is a set of reusable and extensible components designed to be compatible with Velox. Its primary purpose is to simplify the process…☆58Updated this week
- A compute manifest and composable tools for ML, built on Ibis, DataFusion, and Arrow Flight.☆484Updated this week
- Apache Iceberg☆8,516Feb 7, 2026Updated last week
- Official Rust implementation of Apache Arrow☆3,355Feb 6, 2026Updated last week