Alternatives and similar repositories for superglue

Users that are interested in superglue are comparing it to the libraries listed below

• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆182Updated last month
• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆96Updated this week
• cuebook / cuelake
  Use SQL to build ELT pipelines on a data lakehouse.
  ☆288Updated 3 years ago
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆124Updated this week
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆100Updated last week
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆233Updated 7 months ago
• tokern / data-lineage
  Generate and Visualize Data Lineage from query history
  ☆327Updated 2 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated last year
• databand-ai / dbnd
  DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.
  ☆266Updated 5 months ago
• getindata / kafka-connect-iceberg-sink
  ☆80Updated 4 months ago
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆52Updated 2 months ago
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆38Updated last year
• sibytes / yetl
  Yet Another (Spark) ETL Framework
  ☆21Updated last year
• rovio / rovio-ingest
  An implementation of the DatasourceV2 interface of Apache Spark™ for writing Spark Datasets to Apache Druid™.
  ☆43Updated 2 months ago
• TrivadisPF / platys-modern-data-platform
  Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....
  ☆76Updated this week
• airbnb / sputnik
  ☆63Updated 5 years ago
• MaterializeInc / datagen
  Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format.
  ☆165Updated 9 months ago
• agile-lab-dev / DataQuality
  DataQuality for BigData
  ☆144Updated last year
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆64Updated 3 years ago
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆100Updated 2 years ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆229Updated last month
• amundsen-io / amundsendatabuilder
  Data ingestion library for Amundsen to build graph and search index
  ☆204Updated last year
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆29Updated last week
• ananthdurai / schemata
  Schema modelling framework for decentralised domain-driven ownership of data.
  ☆256Updated last year
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆229Updated this week
• metriql / metriql
  The metrics layer for your data. Join us at https://metriql.com/slack
  ☆312Updated 2 years ago
• manuzhang / awesome-lakehouse
  a curated list of awesome lakehouse frameworks, applications, etc
  ☆35Updated 6 months ago
• sodadata / soda-sql
  Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html
  ☆61Updated 2 years ago
• dbt-labs / dbt-presto
  [ARCHIVED] The Presto adapter plugin for dbt Core
  ☆33Updated last year
• victorcouste / trino-dbt-demo
  Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database
  ☆76Updated 3 years ago