Visualize column-level data lineage in Spark SQL
☆92May 13, 2022Updated 3 years ago
Alternatives and similar repositories for spark-sql-flow-plugin
Users that are interested in spark-sql-flow-plugin are comparing it to the libraries listed below
Sorting:
- Client libraries of end users of Apache Kyuubi☆11Jan 10, 2023Updated 3 years ago
- Data Sketches for Apache Spark☆22Dec 22, 2022Updated 3 years ago
- Provide functionality to build statistical models to repair dirty tabular data in Spark☆12Apr 21, 2023Updated 2 years ago
- This repo stores my Spark Tutorial slides.☆15Feb 8, 2016Updated 10 years ago
- Alerting and monitoring tool for Apache Spark☆23May 20, 2022Updated 3 years ago
- Lakehouse storage system benchmark☆78Feb 22, 2023Updated 3 years ago
- An Extensible Data Skipping Framework☆48Jul 15, 2025Updated 7 months ago
- Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.☆257Feb 21, 2023Updated 3 years ago
- A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.☆347May 31, 2024Updated last year
- On the fly, translation of Spark programs to run natively on your Oracle DB. Your Spark programs require no changes.☆35Apr 15, 2025Updated 10 months ago
- Paper: A Zero-rename committer for object stores☆20Nov 7, 2025Updated 3 months ago
- ☆17Mar 19, 2024Updated last year
- Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.☆888Feb 9, 2026Updated 2 weeks ago
- Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.☆1,039Updated this week
- All the things about TPC-DS in Apache Spark☆109Jun 15, 2023Updated 2 years ago
- fast spark local mode☆35Aug 20, 2018Updated 7 years ago
- 基于 antlr4 的多种数据库SQL解析器，获取SQL中元数据，可用于数据平台产品中的多个场景：ddl语句提取元数据、sql 权限校验、表级血缘、sql语法校验等场景。支持spark、flink、gauss、starrocks、Oracle、MYSQL、Postgresq…☆401Feb 12, 2026Updated 2 weeks ago
- 请求spark rest API获取applications，jobs，stages，executors，rdds，streaming，environment等信息提供监控和报警服务☆11Nov 22, 2018Updated 7 years ago
- Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.☆37Jan 3, 2023Updated 3 years ago
- A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL☆46Dec 14, 2025Updated 2 months ago
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆446Feb 12, 2026Updated 2 weeks ago
- Data Lineage Tracking And Visualization Solution☆656Updated this week
- A Spark Atlas connector to track data lineage in Apache Atlas☆266Nov 16, 2022Updated 3 years ago
- The Internals of PySpark☆27Dec 29, 2024Updated last year
- SQL Lineage Analysis Tool powered by Python☆1,620Jan 22, 2026Updated last month
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,516Updated this week
- JVMCI examples for Java Day Tokyo 2017☆10Sep 30, 2019Updated 6 years ago
- Spark SQL listener to record lineage information☆28Jan 24, 2021Updated 5 years ago
- A tool to get better debug info on spark's memory usage☆42Aug 21, 2019Updated 6 years ago
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆334Sep 29, 2023Updated 2 years ago
- A re-implementation of Hadoop DistCP in Apache Spark☆47Dec 20, 2023Updated 2 years ago
- JupyterLab Notebook for Mesosphere DC/OS☆11Aug 6, 2019Updated 6 years ago
- Spark ClickHouse Connector build on DataSourceV2 API☆212Feb 20, 2026Updated last week
- A playground for experimenting ideas that may apply to Spark SQL/Catalyst☆142Jul 5, 2018Updated 7 years ago
- SQL Benchmark derived from TPC-H☆11May 20, 2023Updated 2 years ago
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆17Jan 4, 2026Updated last month
- Generate and Visualize Data Lineage from query history☆327Aug 4, 2023Updated 2 years ago
- An Open Standard for lineage metadata collection☆2,324Feb 22, 2026Updated last week
- A library that brings useful functions from various modern database management systems to Apache Spark☆61Sep 4, 2023Updated 2 years ago