Next-Gen Big Data File Format
☆659Oct 11, 2025Updated 4 months ago
Alternatives and similar repositories for FastLanes
Users that are interested in FastLanes are comparing it to the libraries listed below
Sorting:
- BtrBlocks: Efficient Columnar Compression for Data Lakes (SIGMOD 2023 Paper)☆279Apr 7, 2025Updated 10 months ago
- Rust implementation of the FastLanes compression library☆163Updated this week
- Fast Static Symbol Table (FSST): efficient random-access string compression☆499Nov 26, 2025Updated 3 months ago
- An extensible, state of the art columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Li…☆2,742Updated this week
- New file format for storage of large columnar datasets.☆693Updated this week
- AnyBlob - A Universal Cloud Object Storage Download Manager Built For Cost-Throughput Optimal Analytics!☆145Feb 11, 2026Updated 2 weeks ago
- ☆609Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆4,065Updated this week
- Extension for DuckDB for functions that require the Apache Arrow dependency☆45May 12, 2025Updated 9 months ago
- InkFuse - An Experimental Database Runtime Unifying Vectorized and Compiled Query Execution.☆55May 13, 2024Updated last year
- The FastPFOR C++ library: Fast integer compression☆961Jan 27, 2026Updated last month
- Distributed pushdown cache for DataFusion☆385Feb 21, 2026Updated last week
- ⚡ PDX: A Library for Fast Vector Search and Indexing on CPUs (x86, ARM) — for Python and C++. Index millions of vectors in seconds. Searc…☆72Updated this week
- Hybrid in-memory and disk cache in Rust☆1,639Updated this week
- Reproducibility package for "Robust Join Processing with Diamond Hardened Joins"☆12Jul 10, 2024Updated last year
- CMU-DB's Cascades optimizer framework☆405Jan 6, 2025Updated last year
- Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data ve…☆6,074Updated this week
- Pure-Rust implementation of Fast Static Symbol Tables string compression☆208Updated this week
- TPC-H benchmark data generation in pure Rust☆232Feb 23, 2026Updated last week
- [SIGMOD 2026] F3: The Open-Source Data File Format for the Future☆412Nov 3, 2025Updated 3 months ago
- Accelerating GPU Data Processing using FastLanes Compression☆16May 9, 2024Updated last year
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,476Updated this week
- C++ library to pack and unpack vectors of integers having a small range of values using a technique called Frame of Reference☆54Feb 19, 2024Updated 2 years ago
- Apache DataFusion Comet Spark Accelerator☆1,148Updated this week
- Apache DataFusion SQL Query Engine☆8,462Updated this week
- ☆15Feb 16, 2026Updated last week
- Tonbo is an embedded database for serverless and edge runtimes.☆1,497Feb 20, 2026Updated last week
- DuckDB Pyroscope Extension for Continuous Profiling☆21Feb 18, 2026Updated last week
- ☆884Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,977Updated this week
- C++20 idiomatic APIs for the Apache Arrow Columnar Format☆135Feb 9, 2026Updated 2 weeks ago
- High throughput streaming of Protobuf data from Kafka into DuckDB☆12Jan 26, 2026Updated last month
- (Det)erministic deadl(ock) resolution for high-throughput, low-latency, and strongly consistent data stores.☆28May 12, 2025Updated 9 months ago
- Template for DuckDB extensions to help you develop, test and deploy a custom extension☆264Feb 5, 2026Updated 3 weeks ago
- This is the source code for our (Tobias Ziegler, Carsten Binnig and Viktor Leis) published paper at SIGMOD’22: ScaleStore: A Fast and Cos…☆127Oct 10, 2024Updated last year
- Pluggable in-process caching engine to build and scale high performance services☆1,498Updated this week
- SBoost is a SIMD-based C++ library enabling fast filtering and decoding of lightweight encoded data☆11Jul 6, 2021Updated 4 years ago
- A four-dimensional Analysis of Partitioned Approximate Filters☆11Aug 6, 2025Updated 6 months ago
- EpochFS is a versioned cloud file system with git-like branching, transaction support.☆17Feb 3, 2026Updated 3 weeks ago