cylondata / twister2
A composable framework for fast and scalable data analytics
☆57Updated 2 years ago
Alternatives and similar repositories for twister2:
Users that are interested in twister2 are comparing it to the libraries listed below
- Albis: High-Performance File Format for Big Data Systems☆21Updated 6 years ago
- Fast I/O plugins for Spark☆41Updated 4 years ago
- [Archived] A Fast Multi-tiered Distributed Storage System based on User-Level I/O☆72Updated 7 years ago
- Mirror of Apache crail (Incubating)☆149Updated 2 years ago
- Hadoop Profiler, or hprofiler, is a tool which is able to analyze on- and off-CPU workloads on distributed computing environments.☆24Updated 8 years ago
- A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer☆49Updated last year
- Moved to Apache Mnemonic (Incubator)☆20Updated 8 years ago
- Stocator is high performing connector to object storage for Apache Spark, achieving performance by leveraging object storage semantics.☆114Updated 10 months ago
- LinkedIn's version of Apache Calcite☆22Updated 4 months ago
- ☆105Updated last year
- Self regulation and auto-tuning for distributed system☆65Updated last year
- Spark* shuffle plugin for support shuffling data through a remote Hadoop-compatible file system, as opposed to vanilla Spark's local-dis…☆21Updated last year
- Spark Shuffle Optimization with RDMA+AEP☆30Updated last year
- ☆82Updated this week
- Quark is a data virtualization engine over analytic databases.☆98Updated 7 years ago
- Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange☆127Updated 3 months ago
- Rheem - a cross-platform data processing system☆5Updated 3 years ago
- A NVMf library for Java☆29Updated 5 years ago
- Apache datasketches☆95Updated 2 years ago
- Thoughts on things I find interesting.☆17Updated 3 months ago
- Cascading on Apache Flink®☆54Updated last year
- Running TPC-H on Apache Hive☆41Updated 5 years ago
- SamzaSQL: Streaming SQL implementation on top of Apache Samza and Apache Kafka☆29Updated 8 years ago
- Cache File System optimized for columnar formats and object stores☆183Updated 2 years ago
- Dione - a Spark and HDFS indexing library☆52Updated last year
- JVM integration for Weld☆16Updated 6 years ago
- ☆13Updated last year
- Parquet file generator☆22Updated 6 years ago
- Measuring the performance of popular streaming engines with Yahoo's Streaming Benchmark☆53Updated 5 years ago
- Performance Analysis Tool☆76Updated 2 years ago