4paradigm / pafka
Pafka is originated from the OpenAIOS project to leverage an optimized tiered storage access strategy to improve overall performance for streaming/messaging system.
☆67Updated 3 years ago
Alternatives and similar repositories for pafka:
Users that are interested in pafka are comparing it to the libraries listed below
- alibabacloud-jindodata☆182Updated 3 weeks ago
- ☆63Updated 6 months ago
- Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange☆127Updated 2 months ago
- A Persistent Key-Value Store designed for Streaming processing☆69Updated 3 weeks ago
- Data Infra 研究社☆23Updated 3 months ago
- Clink is a library that provides APIs and infrastructure to facilitate the development of parallelizable feature engineering operators th…☆29Updated 3 years ago
- Mirror of Apache crail (Incubating)☆149Updated 2 years ago
- Mirror of Apache Omid Incubator☆88Updated last week
- ☆32Updated 8 months ago
- An experimental materialized view solution based on TiDB/TiKV and Flink with strong consistency support.☆65Updated 3 years ago
- Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.☆37Updated 2 years ago
- This is OpenMLDB's Spark Distribution, which is particularly optimized for feature extraction. It includes a few novel techniques, such a…☆12Updated 6 months ago
- OpenEmbedding is an open source framework for Tensorflow distributed training acceleration.☆31Updated last year
- DiSNI: Direct Storage and Networking Interface☆189Updated last year
- DS2 is an auto-scaling controller for distributed streaming dataflows☆89Updated last year
- HDFS file read access for ClickHouse☆38Updated last month
- A new C++ vectorized database acceleration library aimed to optimizing query engines and data processing systems.☆22Updated this week
- Key/Value Datastore for Persistent Memory☆27Updated 3 years ago
- Spark Shuffle Optimization with RDMA+AEP☆30Updated last year
- TiKV Java Client☆114Updated 8 months ago
- Star Schema Benchmark dbgen☆121Updated 11 months ago
- Low Level Persistence Library☆98Updated 3 months ago
- The preview version of a spillable state backend for Apache Flink☆39Updated 3 years ago
- ☆71Updated 3 weeks ago
- ☆80Updated last week
- Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆93Updated 8 months ago
- Trino Connector for Apache Paimon.☆31Updated 2 months ago
- TiDB connectors for Flink/Hive/Presto☆216Updated 10 months ago
- continuously update cloud database papers☆81Updated 8 months ago