cylondata / twister2
A composable framework for fast and scalable data analytics
☆57Updated 2 years ago
Alternatives and similar repositories for twister2:
Users that are interested in twister2 are comparing it to the libraries listed below
- Fast I/O plugins for Spark☆41Updated 4 years ago
- [Archived] A Fast Multi-tiered Distributed Storage System based on User-Level I/O☆72Updated 6 years ago
- Mirror of Apache crail (Incubating)☆149Updated 2 years ago
- Albis: High-Performance File Format for Big Data Systems☆21Updated 6 years ago
- ☆13Updated last year
- Spark Shuffle Optimization with RDMA+AEP☆30Updated last year
- A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer☆49Updated last year
- The Musketeer workflow manager.☆41Updated 6 years ago
- Measuring the performance of popular streaming engines with Yahoo's Streaming Benchmark☆53Updated 5 years ago
- Cascading on Apache Flink®☆54Updated last year
- Spooker is a dynamic framework for processing high volume data streams via processing pipelines☆29Updated 9 years ago
- JVM integration for Weld☆16Updated 6 years ago
- Hadoop Profiler, or hprofiler, is a tool which is able to analyze on- and off-CPU workloads on distributed computing environments.☆24Updated 8 years ago
- Self regulation and auto-tuning for distributed system☆65Updated last year
- Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients☆36Updated 3 years ago
- Apache datasketches☆94Updated 2 years ago
- ☆105Updated last year
- SamzaSQL: Streaming SQL implementation on top of Apache Samza and Apache Kafka☆29Updated 8 years ago
- Stocator is high performing connector to object storage for Apache Spark, achieving performance by leveraging object storage semantics.☆114Updated 9 months ago
- LinkedIn's version of Apache Calcite☆22Updated 3 months ago
- ☆80Updated last week
- Rheem - a cross-platform data processing system☆5Updated 2 years ago
- Dione - a Spark and HDFS indexing library☆51Updated 11 months ago
- Parquet file generator☆22Updated 6 years ago
- Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…☆41Updated 2 years ago
- A temporary home for LinkedIn's changes to Apache Iceberg (incubating)☆62Updated 2 months ago
- Quark is a data virtualization engine over analytic databases.☆98Updated 7 years ago
- Apache Mnemonic - A non-volatile hybrid memory storage oriented library☆120Updated last month
- Dremio Flight connector. Access Dremio using Arrow flight☆40Updated 4 years ago
- A streaming key-value store implementation using native Flink Streaming operators☆23Updated 9 years ago