tinyclues / spark-glue-data-catalogLinks
Apache Spark build compatible with AWS Glue Data Catalog.
☆19Updated 4 years ago
Alternatives and similar repositories for spark-glue-data-catalog
Users that are interested in spark-glue-data-catalog are comparing it to the libraries listed below
Sorting:
- The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…☆227Updated 10 months ago
- ☆81Updated 9 months ago
- Snowflake Data Source for Apache Spark.☆230Updated 3 weeks ago
- Performant Redshift data source for Apache Spark☆141Updated 3 weeks ago
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive☆186Updated 3 months ago
- Avro SerDe for Apache Spark structured APIs.☆242Updated 8 months ago
- ACID Data Source for Apache Spark based on Hive ACID☆96Updated 4 years ago
- A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.☆347Updated last year
- Snowflake JDBC Driver☆197Updated this week
- Adapter for dbt that executes dbt pipelines on Apache Flink☆96Updated last year
- The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them☆136Updated 2 years ago
- Kinesis Connector for Structured Streaming☆138Updated last year
- Iceberg is a table format for large, slow-moving tabular data☆489Updated 2 years ago
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆94Updated 9 months ago
- The Internals of Delta Lake☆187Updated 2 months ago
- Helm charts for Trino and Trino Gateway☆192Updated last week
- Spark Structured Streaming State Tools☆34Updated 5 years ago
- A library that provides useful extensions to Apache Spark and PySpark.☆232Updated 3 weeks ago
- Kafka Connector for Iceberg tables☆16Updated 2 years ago
- Smart Automation Tool for building modern Data Lakes and Data Pipelines☆122Updated last week
- A load balancer / proxy / gateway for prestodb☆358Updated last year
- Flowchart for debugging Spark applications☆106Updated last year
- a curated list of awesome lakehouse frameworks, applications, etc☆40Updated this week
- Build configuration-driven ETL pipelines on Apache Spark☆161Updated 3 years ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆70Updated 5 months ago
- Setup for running Trino with Hive Metastore on Kubernetes☆103Updated 3 years ago
- A simplified, lightweight ETL Framework based on Apache Spark☆589Updated 2 years ago
- This project provides a reverse proxy for Spark UI on Kubernetes☆17Updated 2 years ago
- Hadoop output committers for S3☆113Updated 5 years ago
- Apiary provides modules which can be combined to create a federated cloud data lake☆37Updated last year