cylondata / twister2Links
A composable framework for fast and scalable data analytics
☆57Updated 2 years ago
Alternatives and similar repositories for twister2
Users that are interested in twister2 are comparing it to the libraries listed below
Sorting:
- [Archived] A Fast Multi-tiered Distributed Storage System based on User-Level I/O☆73Updated 7 years ago
- Mirror of Apache crail (Incubating)☆150Updated 2 years ago
- A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer☆50Updated last year
- Fast I/O plugins for Spark☆41Updated 4 years ago
- Measuring the performance of popular streaming engines with Yahoo's Streaming Benchmark☆53Updated 6 years ago
- ☆13Updated 2 years ago
- Moved to Apache Mnemonic (Incubator)☆20Updated 9 years ago
- Spark Shuffle Optimization with RDMA+AEP☆30Updated 2 years ago
- Self regulation and auto-tuning for distributed system☆65Updated last year
- Albis: High-Performance File Format for Big Data Systems☆21Updated 6 years ago
- Cascading on Apache Flink®☆54Updated last year
- Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients☆36Updated 4 years ago
- Hadoop Profiler, or hprofiler, is a tool which is able to analyze on- and off-CPU workloads on distributed computing environments.☆24Updated 8 years ago
- The Musketeer workflow manager.☆41Updated 6 years ago
- LinkedIn's version of Apache Calcite☆23Updated last week
- ☆84Updated last week
- Parquet file generator☆22Updated 7 years ago
- Spooker is a dynamic framework for processing high volume data streams via processing pipelines☆29Updated 9 years ago
- ☆105Updated last year
- Spark GPU and SIMD Support☆61Updated 4 years ago
- A NVMf library for Java☆29Updated 5 years ago
- Dione - a Spark and HDFS indexing library☆52Updated last year
- Apache Quickstep Incubator - This project is retired☆95Updated 6 years ago
- Demonstration of a Hive Input Format for Iceberg☆26Updated 4 years ago
- Apache Mnemonic - A non-volatile hybrid memory storage oriented library☆119Updated 3 months ago
- Performance Analysis Tool☆76Updated this week
- Condor allows for the specification of synopsis-based streaming jobs on top of general dataflow systems. Condor provides a collection of …☆13Updated 11 months ago
- Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange☆127Updated 5 months ago
- A streaming key-value store implementation using native Flink Streaming operators☆23Updated 9 years ago
- A tool for scale and performance testing of HDFS with a specific focus on the NameNode.☆131Updated last year