Visualize column-level data lineage in Spark SQL
☆92May 13, 2022Updated 4 years ago
Alternatives and similar repositories for spark-sql-flow-plugin
Users that are interested in spark-sql-flow-plugin are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Client libraries of end users of Apache Kyuubi☆11May 15, 2026Updated 5 months ago
- A simple toolkit to analyze Spark query logs☆10Jun 22, 2021Updated 5 years ago
- fast spark local mode☆35Aug 20, 2018Updated 8 years ago
- Provide functionality to build statistical models to repair dirty tabular data in Spark☆11Apr 21, 2023Updated 3 years ago
- Data Sketches for Apache Spark☆20Dec 22, 2022Updated 3 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.☆908Oct 1, 2026Updated 3 weeks ago
- Data Lineage Tracking And Visualization Solution☆668Oct 8, 2026Updated 3 weeks ago
- 基于 antlr4 的多种数据库SQL解析器，获取SQL中元数据，可用于数据平台产品中的多个场景：ddl语句提取元数据、sql 权限校验、表级血缘、sql语法校验等场景。支持spark、flink、gauss、starrocks、Oracle、MYSQL、Postgresq…☆423Sep 9, 2026Updated last month
- A tool to get better debug info on spark's memory usage☆42Aug 21, 2019Updated 7 years ago
- Lakehouse storage system benchmark☆82Feb 22, 2023Updated 3 years ago
- Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.☆1,078Updated this week
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆455Oct 20, 2026Updated last week
- Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.☆255Feb 21, 2023Updated 3 years ago
- ☆17Mar 19, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A re-implementation of Hadoop DistCP in Apache Spark☆47Dec 20, 2023Updated 2 years ago
- A playground for experimenting ideas that may apply to Spark SQL/Catalyst☆143Jul 5, 2018Updated 8 years ago
- Spark SQL listener to record lineage information☆28Jan 24, 2021Updated 5 years ago
- A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.☆344May 31, 2024Updated 2 years ago
- An Extensible Data Skipping Framework☆50Jul 15, 2025Updated last year
- A Spark Atlas connector to track data lineage in Apache Atlas☆267Nov 16, 2022Updated 3 years ago
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,611Updated this week
- The Lightning Catalog is an open-source data catalog designed for preparing data at any scale in ad-hoc analytics, data virtualization, …☆41Feb 5, 2026Updated 8 months ago
- SQL Lineage Analysis Tool powered by Python☆1,682Oct 23, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- On the fly, translation of Spark programs to run natively on your Oracle DB. Your Spark programs require no changes.☆36Apr 15, 2025Updated last year
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆335Sep 29, 2023Updated 3 years ago
- 请求spark rest API获取applications，jobs，stages，executors，rdds，streaming，environment等信息提供监控和报警服务☆11Nov 22, 2018Updated 7 years ago
- This repo stores my Spark Tutorial slides.☆15Feb 8, 2016Updated 10 years ago
- A Spark plugin for CPU and memory profiling☆21Mar 17, 2026Updated 7 months ago
- Spark ClickHouse Connector build on DataSourceV2 API☆217Oct 22, 2026Updated last week
- The Internals of PySpark☆28Dec 29, 2024Updated last year
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,372Updated this week
- A data lineage tool detects table dependencies from rendered SQL statements.☆30Mar 14, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Sample code for building a Python application for Apache Flink on Kinesis Data Analytics.☆14Sep 1, 2026Updated last month
- Generate and Visualize Data Lineage from query history☆324Aug 4, 2023Updated 3 years ago
- Apache Auron is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.☆1,838Updated this week
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆16Jul 28, 2026Updated 3 months ago
- Varka is a vectorized codegen for Spark SQL☆20Updated this week
- Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shu…☆255Apr 7, 2023Updated 3 years ago
- A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL☆50Jun 7, 2026Updated 4 months ago