4paradigm / spark
This is OpenMLDB's Spark Distribution, which is particularly optimized for feature extraction. It includes a few novel techniques, such as native implementation of last join and multi-window parallelization. Its APIs are fully compatible with the standard Spark. It is designed to be a component of OpenMLDB (https://github.com/4paradigm/OpenMLDB)…
☆11Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for spark
- Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.☆37Updated last year
- Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.☆256Updated last year
- All the things about TPC-DS in Apache Spark☆104Updated last year
- ☆91Updated 2 weeks ago
- A series of Jupyter notebooks to demonstrate the functionality of Apache Calcite☆53Updated 4 years ago
- The preview version of a spillable state backend for Apache Flink☆39Updated 3 years ago
- Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange☆127Updated last month
- ☆46Updated 2 years ago
- ☆63Updated 2 months ago
- Mirror of Apache crail (Incubating)☆148Updated 2 years ago
- Pafka is originated from the OpenAIOS project to leverage an optimized tiered storage access strategy to improve overall performance for …☆67Updated 2 years ago
- Spark* shuffle plugin for support shuffling data through a remote Hadoop-compatible file system, as opposed to vanilla Spark's local-dis…☆20Updated 7 months ago
- A tool to get better debug info on spark's memory usage☆42Updated 5 years ago
- A playground for experimenting ideas that may apply to Spark SQL/Catalyst☆139Updated 6 years ago
- A simple optimizing Brainfuck compiler (used as the demo for my QCon Beijing 2015 talk)☆63Updated 2 years ago
- hadoop-cos（CosN文件系统）为Apache Hadoop、Spark以及Tez等大数据计算框架集成提供支持，可以像访问HDFS一样读写存储在腾讯云COS上的数据。同时也支持作为Druid等查询与分析引擎的Deep Storage☆82Updated this week
- Port of TPC-DS dsdgen to Java☆20Updated last year
- ☆76Updated 2 weeks ago
- Spark Shuffle Optimization with RDMA+AEP☆30Updated last year
- Client libraries of end users of Apache Kyuubi☆11Updated last year
- Mirror of Apache Hive☆32Updated 4 years ago
- Mirror of Apache Omid Incubator☆87Updated this week
- Visualize column-level data lineage in Spark SQL☆87Updated 2 years ago
- Gluten: Plugin to Boost Trino's Performance☆70Updated last year
- Plugin for Presto to allow addition of user functions easily☆116Updated 3 years ago
- Shared files, presentations, and other materials☆34Updated last week