Visualize column-level data lineage in Spark SQL
☆92May 13, 2022Updated 3 years ago
Alternatives and similar repositories for spark-sql-flow-plugin
Users that are interested in spark-sql-flow-plugin are comparing it to the libraries listed below
Sorting:
- Client libraries of end users of Apache Kyuubi☆11Jan 10, 2023Updated 3 years ago
- fast spark local mode☆35Aug 20, 2018Updated 7 years ago
- Lakehouse storage system benchmark☆78Feb 22, 2023Updated 3 years ago
- Data Sketches for Apache Spark☆22Dec 22, 2022Updated 3 years ago
- Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.☆892Mar 10, 2026Updated last week
- Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.☆257Feb 21, 2023Updated 3 years ago
- Provide functionality to build statistical models to repair dirty tabular data in Spark☆12Apr 21, 2023Updated 2 years ago
- 基于 antlr4 的多种数据库SQL解析器，获取SQL中元数据，可用于数据平台产品中的多个场景：ddl语句提取元数据、sql 权限校验、表级血缘、sql语法校验等场景。支持spark、flink、gauss、starrocks、Oracle、MYSQL、Postgresq…☆407Mar 10, 2026Updated last week
- An Extensible Data Skipping Framework☆48Jul 15, 2025Updated 8 months ago
- ☆17Mar 19, 2024Updated 2 years ago
- Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.☆1,039Updated this week
- A tool to get better debug info on spark's memory usage☆42Aug 21, 2019Updated 6 years ago
- A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.☆346May 31, 2024Updated last year
- Data Lineage Tracking And Visualization Solution☆656Updated this week
- A Spark Atlas connector to track data lineage in Apache Atlas☆266Nov 16, 2022Updated 3 years ago
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆446Updated this week
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,530Updated this week
- On the fly, translation of Spark programs to run natively on your Oracle DB. Your Spark programs require no changes.☆35Apr 15, 2025Updated 11 months ago
- This repo stores my Spark Tutorial slides.☆15Feb 8, 2016Updated 10 years ago
- The Internals of PySpark☆28Dec 29, 2024Updated last year
- A re-implementation of Hadoop DistCP in Apache Spark☆47Dec 20, 2023Updated 2 years ago
- Alerting and monitoring tool for Apache Spark☆23May 20, 2022Updated 3 years ago
- SQL Lineage Analysis Tool powered by Python☆1,628Mar 1, 2026Updated 2 weeks ago
- A playground for experimenting ideas that may apply to Spark SQL/Catalyst☆142Jul 5, 2018Updated 7 years ago
- 请求spark rest API获取applications，jobs，stages，executors，rdds，streaming，environment等信息提供监控和报警服务☆11Nov 22, 2018Updated 7 years ago
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆16Jan 4, 2026Updated 2 months ago
- A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL☆46Dec 14, 2025Updated 3 months ago
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆335Sep 29, 2023Updated 2 years ago
- An Open Standard for lineage metadata collection☆2,362Updated this week
- JVMCI examples for Java Day Tokyo 2017☆10Sep 30, 2019Updated 6 years ago
- The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query process…☆1,730Updated this week
- A data lineage tool detects table dependencies from rendered SQL statements.☆30Mar 14, 2026Updated last week
- All the things about TPC-DS in Apache Spark☆109Jun 15, 2023Updated 2 years ago
- Spark ClickHouse Connector build on DataSourceV2 API☆213Mar 8, 2026Updated last week
- Spark Structured Streaming State Tools☆34Jul 3, 2020Updated 5 years ago
- Generate and Visualize Data Lineage from query history☆327Aug 4, 2023Updated 2 years ago
- Go Client for Hive Metastore☆14Dec 18, 2022Updated 3 years ago
- Spark SQL listener to record lineage information☆28Jan 24, 2021Updated 5 years ago
- Custom state store providers for Apache Spark☆92Feb 14, 2025Updated last year