Visualize column-level data lineage in Spark SQL
☆92May 13, 2022Updated 4 years ago
Alternatives and similar repositories for spark-sql-flow-plugin
Users that are interested in spark-sql-flow-plugin are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Client libraries of end users of Apache Kyuubi☆11Updated this week
- fast spark local mode☆35Aug 20, 2018Updated 7 years ago
- Lakehouse storage system benchmark☆81Feb 22, 2023Updated 3 years ago
- Data Sketches for Apache Spark☆22Dec 22, 2022Updated 3 years ago
- Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.☆898May 11, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.☆256Feb 21, 2023Updated 3 years ago
- Provide functionality to build statistical models to repair dirty tabular data in Spark☆12Apr 21, 2023Updated 3 years ago
- 基于 antlr4 的多种数据库SQL解析器，获取SQL中元数据，可用于数据平台产品中的多个场景：ddl语句提取元数据、sql 权限校验、表级血缘、sql语法校验等场景。支持spark、flink、gauss、starrocks、Oracle、MYSQL、Postgresq…☆410Mar 25, 2026Updated last month
- ☆17Mar 19, 2024Updated 2 years ago
- An Extensible Data Skipping Framework☆48Jul 15, 2025Updated 10 months ago
- Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.☆1,044May 14, 2026Updated last week
- A tool to get better debug info on spark's memory usage☆42Aug 21, 2019Updated 6 years ago
- A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.☆346May 31, 2024Updated last year
- Data Lineage Tracking And Visualization Solution☆658May 12, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Spark Atlas connector to track data lineage in Apache Atlas☆268Nov 16, 2022Updated 3 years ago
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆451May 12, 2026Updated last week
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,560Updated this week
- On the fly, translation of Spark programs to run natively on your Oracle DB. Your Spark programs require no changes.☆35Apr 15, 2025Updated last year
- This repo stores my Spark Tutorial slides.☆15Feb 8, 2016Updated 10 years ago
- The Internals of PySpark☆28Dec 29, 2024Updated last year
- A re-implementation of Hadoop DistCP in Apache Spark☆47Dec 20, 2023Updated 2 years ago
- Alerting and monitoring tool for Apache Spark☆23May 20, 2022Updated 4 years ago
- SQL Lineage Analysis Tool powered by Python☆1,651Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A playground for experimenting ideas that may apply to Spark SQL/Catalyst☆143Jul 5, 2018Updated 7 years ago
- 请求spark rest API获取applications，jobs，stages，executors，rdds，streaming，environment等信息提供监控和报警服务☆11Nov 22, 2018Updated 7 years ago
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆16Jan 4, 2026Updated 4 months ago
- A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL☆48Apr 16, 2026Updated last month
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆335Sep 29, 2023Updated 2 years ago
- An Open Standard for lineage metadata collection☆2,460Updated this week
- The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query process…☆1,762Updated this week
- A data lineage tool detects table dependencies from rendered SQL statements.☆30Mar 14, 2026Updated 2 months ago
- All the things about TPC-DS in Apache Spark☆111Jun 15, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Spark ClickHouse Connector build on DataSourceV2 API☆217May 12, 2026Updated last week
- Spark Structured Streaming State Tools☆34Jul 3, 2020Updated 5 years ago
- Generate and Visualize Data Lineage from query history☆327Aug 4, 2023Updated 2 years ago
- Go Client for Hive Metastore☆14Dec 18, 2022Updated 3 years ago
- Spark SQL listener to record lineage information☆28Jan 24, 2021Updated 5 years ago
- Custom state store providers for Apache Spark☆92Feb 14, 2025Updated last year
- SparkCube is an open-source project for extremely fast OLAP data analysis. SparkCube is an extension of Apache Spark.☆136Mar 6, 2023Updated 3 years ago