apache / orc-formatLinks
Apache ORC - the smallest, fastest columnar storage for Hadoop workloads
☆16Updated 5 months ago
Alternatives and similar repositories for orc-format
Users that are interested in orc-format are comparing it to the libraries listed below
Sorting:
- Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.☆258Updated 2 years ago
- ☆67Updated last year
- All the things about TPC-DS in Apache Spark☆109Updated 2 years ago
- An Extensible Data Skipping Framework☆47Updated 6 months ago
- Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.☆37Updated 3 years ago
- A re-implementation of Hadoop DistCP in Apache Spark☆47Updated 2 years ago
- Community Java bindings for https://github.com/facebookincubator/velox☆38Updated this week
- Lakehouse storage system benchmark☆77Updated 2 years ago
- Cache File System optimized for columnar formats and object stores☆187Updated 3 years ago
- Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange☆130Updated last year
- A Persistent Key-Value Store designed for Streaming processing☆119Updated 3 weeks ago
- Apache Iceberg C++☆188Updated last week
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆442Updated last week
- A software library of stochastic streaming algorithms, a.k.a. sketches.☆105Updated 2 weeks ago
- ☆96Updated this week
- A new C++ vectorized database acceleration library aimed to optimizing query engines and data processing systems.☆31Updated this week
- Spark Shuffle Optimization with RDMA+AEP☆30Updated 2 years ago
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆336Updated 2 years ago
- Remote Shuffle Service for Flink☆191Updated 3 years ago
- Mirror of Apache crail (Incubating)☆151Updated 3 years ago
- Benchmarks for Apache Flink☆184Updated last month
- Spark* shuffle plugin for support shuffling data through a remote Hadoop-compatible file system, as opposed to vanilla Spark's local-dis…☆21Updated last year
- SparkCube is an open-source project for extremely fast OLAP data analysis. SparkCube is an extension of Apache Spark.☆136Updated 2 years ago
- A S3 Shuffle plugin for Apache Spark to enable elastic scaling for generic Spark workloads.☆51Updated 4 months ago
- DS2 is an auto-scaling controller for distributed streaming dataflows☆91Updated 2 years ago
- Benchmarks for queries over continuous data streams.☆376Updated last month
- Spark SQL index for Parquet tables☆134Updated 4 years ago
- Serializable ACID transactions on streaming data☆25Updated 3 years ago
- Gluten: Plugin to Boost Trino's Performance☆76Updated 2 years ago
- A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Ap…☆303Updated 3 months ago