4paradigm / pafka
Pafka is originated from the OpenAIOS project to leverage an optimized tiered storage access strategy to improve overall performance for streaming/messaging system.
☆67Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for pafka
- alibabacloud-jindodata☆177Updated this week
- Mirror of Apache crail (Incubating)☆148Updated 2 years ago
- Mirror of Apache Omid Incubator☆87Updated this week
- ☆32Updated 5 months ago
- ☆63Updated 2 months ago
- Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange☆127Updated last month
- Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆90Updated 4 months ago
- Clink is a library that provides APIs and infrastructure to facilitate the development of parallelizable feature engineering operators th…☆28Updated 2 years ago
- Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.☆37Updated last year
- Benchmarks for queries over continuous data streams.☆309Updated 2 months ago
- Spark Shuffle Optimization with RDMA+AEP☆30Updated last year
- An experimental materialized view solution based on TiDB/TiKV and Flink with strong consistency support.☆65Updated 3 years ago
- ☆57Updated 4 years ago
- The preview version of a spillable state backend for Apache Flink☆39Updated 3 years ago
- DS2 is an auto-scaling controller for distributed streaming dataflows☆89Updated last year
- Low Level Persistence Library☆98Updated this week
- HDFS file read access for ClickHouse☆36Updated 3 weeks ago
- OpenEmbedding is an open source framework for Tensorflow distributed training acceleration.☆31Updated last year
- DiSNI: Direct Storage and Networking Interface☆186Updated last year
- Star Schema Benchmark dbgen☆120Updated 7 months ago
- ☆19Updated last year
- ☆46Updated 2 years ago
- Key/Value Datastore for Persistent Memory☆27Updated 3 years ago
- Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shu…☆252Updated last year
- TiDB connectors for Flink/Hive/Presto☆216Updated 6 months ago
- ☆29Updated last month
- A high-performance distributed execution engine☆70Updated 3 weeks ago
- ☆192Updated 11 months ago