sdaberdaku / spark-with-glue-builder
Docker image that builds a patched Apache Spark with AWS Glue support as metastore
☆15Updated 9 months ago
Alternatives and similar repositories for spark-with-glue-builder:
Users that are interested in spark-with-glue-builder are comparing it to the libraries listed below
- ☆79Updated last year
- Adapter for dbt that executes dbt pipelines on Apache Flink☆92Updated last year
- A library that provides useful extensions to Apache Spark and PySpark.☆221Updated last week
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆97Updated 2 years ago
- Avro SerDe for Apache Spark structured APIs.☆233Updated 8 months ago
- ☆189Updated last week
- Apache Spark Kubernetes Operator☆106Updated last week
- The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)☆231Updated last week
- Utility functions for dbt projects running on Trino☆21Updated last year
- Helm charts for Trino and Trino Gateway☆161Updated last week
- CLI tool to bulk migrate the tables from one catalog another without a data copy☆76Updated last month
- Library to convert DBT manifest metadata to Airflow tasks☆48Updated last year
- Flowchart for debugging Spark applications☆105Updated 6 months ago
- ☆261Updated 5 months ago
- A Python Library to support running data quality rules while the spark job is running⚡☆180Updated 2 weeks ago
- The Internals of Delta Lake☆184Updated 2 months ago
- dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks☆424Updated last month
- Delta lake and filesystem helper methods☆51Updated last year
- Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…☆120Updated this week
- Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake☆239Updated this week
- Storage connector for Trino☆106Updated this week
- Snowflake Data Source for Apache Spark.☆222Updated 4 months ago
- Spline agent for Apache Spark☆191Updated 2 weeks ago
- Apache Hive Metastore as a Standalone server in Docker☆70Updated 7 months ago
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive☆185Updated 2 years ago
- Delta Lake helper methods. No Spark dependency.☆23Updated 6 months ago
- Spark style guide☆258Updated 6 months ago
- ☆40Updated 4 years ago
- A repository of sample code to accompany our blog post on Airflow and dbt.☆171Updated last year
- Delta Lake examples☆221Updated 5 months ago