Alternatives and similar repositories for delta-architecture:

Users that are interested in delta-architecture are comparing it to the libraries listed below

• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆79Updated 5 years ago
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆29Updated 2 weeks ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆104Updated 4 months ago
• rovio / rovio-ingest
  An implementation of the DatasourceV2 interface of Apache Spark™ for writing Spark Datasets to Apache Druid™.
  ☆41Updated 3 months ago
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆30Updated 2 months ago
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆49Updated last year
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 3 years ago
• sourav-mazumder / Data-Science-Extensions
  ☆71Updated 3 years ago
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆44Updated 10 months ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆178Updated last year
• polyzos / stream-processing-with-apache-flink
  ☆47Updated 5 months ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year
• victorcouste / trino-dbt-demo
  Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database
  ☆71Updated 3 years ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆61Updated 4 months ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆222Updated last month
• airbnb / sputnik
  ☆63Updated 5 years ago
• ExpediaGroup / apiary
  Apiary provides modules which can be combined to create a federated cloud data lake
  ☆36Updated 9 months ago
• fivetran / benchmark
  Benchmark data warehouses under Fivetran-like conditions
  ☆165Updated 2 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated 9 months ago
• sparsecode / DaFlow
  Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…
  ☆26Updated 3 years ago
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆114Updated this week
• sibytes / yetl
  Yet Another (Spark) ETL Framework
  ☆18Updated last year
• ardlema / kafka-streams-workshop
  ☆67Updated 6 years ago
• MrPowers / bebe
  Filling in the Spark function gaps across APIs
  ☆50Updated 3 years ago
• bartosz25 / acid-file-formats
  Code for Apache Hudi, Apache Iceberg and Delta Lake analysis
  ☆9Updated 11 months ago
• qubole / streamx
  kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
  ☆95Updated 5 years ago
• spark-redshift-community / spark-redshift
  Performant Redshift data source for Apache Spark
  ☆137Updated last week
• developerhq / spark-kubernetes
  Deploy your Spark Production Cluster on Kubernetes
  ☆47Updated 4 years ago
• twalthr / flink-api-examples
  Examples for using Apache Flink® with DataStream API, Table API, Flink SQL and connectors such as MySQL, JDBC, CDC, Kafka.
  ☆61Updated last year
• avensolutions / spark-sql-etl-framework
  Multi-stage, config driven, SQL based ETL framework using PySpark
  ☆25Updated 5 years ago