4paradigm / pafka
Pafka is originated from the OpenAIOS project to leverage an optimized tiered storage access strategy to improve overall performance for streaming/messaging system.
☆67Updated 3 years ago
Alternatives and similar repositories for pafka:
Users that are interested in pafka are comparing it to the libraries listed below
- ☆63Updated 8 months ago
- Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange☆127Updated 4 months ago
- This is OpenMLDB's Spark Distribution, which is particularly optimized for feature extraction. It includes a few novel techniques, such a…☆12Updated 9 months ago
- alibabacloud-jindodata☆188Updated last week
- Mirror of Apache crail (Incubating)☆150Updated 2 years ago
- Clink is a library that provides APIs and infrastructure to facilitate the development of parallelizable feature engineering operators th…☆29Updated 3 years ago
- Mirror of Apache Omid Incubator☆88Updated this week
- ☆35Updated 11 months ago
- Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.☆37Updated 2 years ago
- Spark Shuffle Optimization with RDMA+AEP☆30Updated last year
- HDFS file read access for ClickHouse☆41Updated last month
- Data Infra 研究社☆24Updated 6 months ago
- DiSNI: Direct Storage and Networking Interface☆191Updated 2 years ago
- continuously update cloud database papers☆79Updated 11 months ago
- ☆19Updated last year
- TiKV Java Client☆115Updated 3 weeks ago
- Scalable NameNode RPC Proxy for HDFS Federation☆87Updated 9 years ago
- A Persistent Key-Value Store designed for Streaming processing☆83Updated 2 months ago
- Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆97Updated 10 months ago
- An Extensible Data Skipping Framework☆46Updated 3 months ago
- ☆85Updated last week
- An experimental materialized view solution based on TiDB/TiKV and Flink with strong consistency support.☆65Updated 3 years ago
- Key/Value Datastore for Persistent Memory☆27Updated 3 years ago
- ☆56Updated 4 years ago
- DS2 is an auto-scaling controller for distributed streaming dataflows☆89Updated 2 years ago
- Speed up fsspec data access with Alluxio distributed caching.☆14Updated last month
- Low Level Persistence Library☆98Updated 6 months ago
- Star Schema Benchmark dbgen☆123Updated last year
- A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer☆50Updated last year
- ☆204Updated last year