Alternatives and similar repositories for delta-architecture

Users that are interested in delta-architecture are comparing it to the libraries listed below

• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated last year
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆105Updated 7 months ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• bartosz25 / acid-file-formats
  Code for Apache Hudi, Apache Iceberg and Delta Lake analysis
  ☆9Updated last year
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 5 years ago
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆30Updated 6 months ago
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆37Updated 2 weeks ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆61Updated 8 months ago
• mayur2810 / sope
  Apache Spark ETL Utilities
  ☆40Updated 6 months ago
• ExpediaGroup / apiary
  Apiary provides modules which can be combined to create a federated cloud data lake
  ☆36Updated last year
• airbnb / sputnik
  ☆63Updated 5 years ago
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆44Updated last year
• agile-lab-dev / DataQuality
  DataQuality for BigData
  ☆144Updated last year
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆181Updated last week
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• gtoonstra / databook
  A facebook for data
  ☆26Updated 5 years ago
• Wikia / discreETLy
  ETLy is an add-on dashboard service on top of Apache Airflow.
  ☆68Updated last year
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆185Updated 2 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆59Updated last year
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆38Updated last year
• getindata / doge-datagen
  ☆19Updated 2 years ago
• MrPowers / bebe
  Filling in the Spark function gaps across APIs
  ☆50Updated 4 years ago
• AbsaOSS / spark-hats
  Nested array transformation helper extensions for Apache Spark
  ☆37Updated last year
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆124Updated this week
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆184Updated 4 months ago
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆51Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆223Updated last month
• avensolutions / spark-sql-etl-framework
  Multi-stage, config driven, SQL based ETL framework using PySpark
  ☆25Updated 5 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆71Updated 5 years ago
• ing-bank / rokku
  Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…
  ☆67Updated 2 months ago