SemyonSinchenko / spark-connect-example
An example of SparkConnect extension.
☆11Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for spark-connect-example
- Delta lake and filesystem helper methods☆49Updated 8 months ago
- A Python Library to support running data quality rules while the spark job is running⚡☆163Updated 2 weeks ago
- Custom PySpark Data Sources☆27Updated 2 months ago
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆189Updated this week
- Delta Lake helper methods. No Spark dependency.☆22Updated 2 months ago
- PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows☆41Updated 4 months ago
- A library that provides useful extensions to Apache Spark and PySpark.☆197Updated 3 weeks ago
- Delta Acceptance Testing☆19Updated 4 months ago
- Performance Observability for Apache Spark☆198Updated last week
- Spark style guide☆256Updated last month
- Don't Panic. This guide will help you when it feels like the end of the world.☆21Updated 5 months ago
- Delta Lake helper methods in PySpark☆307Updated 2 months ago
- A simple Spark-powered ETL framework that just works 🍺☆178Updated 11 months ago
- Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).☆16Updated last month
- Delta Lake Website☆24Updated last week
- The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…☆224Updated 3 weeks ago
- Flowchart for debugging Spark applications☆101Updated 2 months ago
- This repo is a collection of tools to deploy, manage and operate a Databricks based Lakehouse.☆41Updated last month
- Adapter for dbt that executes dbt pipelines on Apache Flink☆85Updated 8 months ago
- A Table format agnostic data sharing framework☆38Updated 9 months ago
- Spark-Radiant is Apache Spark Performance and Cost Optimizer☆25Updated 2 years ago
- Delta Lake examples☆209Updated last month