Alternatives and similar repositories for spark-glue-data-catalog

Users that are interested in spark-glue-data-catalog are comparing it to the libraries listed below

• awslabs / aws-glue-data-catalog-client-for-apache-hive-metastore
  The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…
  ☆222Updated 3 months ago
• spark-redshift-community / spark-redshift
  Performant Redshift data source for Apache Spark
  ☆141Updated 2 weeks ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆226Updated last month
• getindata / kafka-connect-iceberg-sink
  ☆80Updated 2 months ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆186Updated 2 years ago
• qubole / kinesis-sql
  Kinesis Connector for Structured Streaming
  ☆136Updated last year
• snowflakedb / snowflake-kafka-connector
  Snowflake Kafka Connector (Sink Connector)
  ☆158Updated last week
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆184Updated 6 months ago
• getindata / dbt-flink-adapter
  Adapter for dbt that executes dbt pipelines on Apache Flink
  ☆95Updated last year
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆344Updated last year
• snowflakedb / snowflake-jdbc
  Snowflake JDBC Driver
  ☆185Updated last week
• AbsaOSS / ABRiS
  Avro SerDe for Apache Spark structured APIs.
  ☆235Updated last month
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆227Updated this week
• qubole / spark-acid
  ACID Data Source for Apache Spark based on Hive ACID
  ☆97Updated 4 years ago
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆79Updated 3 months ago
• qubole / spark-state-store
  Rocksdb state storage implementation for Structured Streaming.
  ☆17Updated 4 years ago
• MarquezProject / marquez-airflow
  Airflow support for Marquez
  ☆32Updated 4 years ago
• datapunchorg / spark-ui-reverse-proxy
  This project provides a reverse proxy for Spark UI on Kubernetes
  ☆15Updated last year
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆88Updated last year
• varadaio / presto-workload-analyzer
  The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them
  ☆135Updated last year
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆181Updated 3 weeks ago
• dbt-labs / dbt-spark
  dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks
  ☆436Updated this week
• trinodb / charts
  Helm charts for Trino and Trino Gateway
  ☆171Updated this week
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆105Updated 9 months ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆64Updated 3 years ago
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆99Updated 2 years ago
• zillow / aws-custom-credential-provider
  A custom AWS credential provider that allows your Hadoop or Spark application access S3 file system by assuming a role
  ☆10Updated 7 years ago
• joshuarobinson / trino-on-k8s
  Setup for running Trino with Hive Metastore on Kubernetes
  ☆101Updated 2 years ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• getindata / dbt-airflow-factory
  Library to convert DBT manifest metadata to Airflow tasks
  ☆48Updated last year