Alternatives and similar repositories for delta-architecture

Users that are interested in delta-architecture are comparing it to the libraries listed below

• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆105Updated 9 months ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆45Updated last week
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 6 years ago
• sourav-mazumder / Data-Science-Extensions
  ☆71Updated 4 years ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆61Updated 9 months ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆37Updated 2 weeks ago
• bartosz25 / acid-file-formats
  Code for Apache Hudi, Apache Iceberg and Delta Lake analysis
  ☆9Updated last year
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆29Updated 7 months ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated last year
• josephadler / eventsim
  Event data simulator. Generates a stream of pseudo-random events from a set of users, designed to simulate web traffic.
  ☆28Updated 7 years ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆181Updated last month
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆101Updated last month
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆38Updated last year
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 4 years ago
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆184Updated 5 months ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆51Updated last week
• mayur2810 / sope
  Apache Spark ETL Utilities
  ☆40Updated 8 months ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆88Updated last year
• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆95Updated last week
• holdenk / sparkProjectTemplate.g8
  Template for Spark Projects
  ☆102Updated last year
• rockthejvm / spark-performance-tuning
  The official repository for the Rock the JVM Spark Optimization 2 course
  ☆40Updated last year
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 2 years ago
• linkedin / Hoptimator
  Multi-hop declarative data pipelines
  ☆115Updated 2 weeks ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• JahstreetOrg / spark-on-kubernetes-docker
  Spark on Kubernetes infrastructure Docker images repo
  ☆37Updated 2 years ago
• ardlema / kafka-streams-workshop
  ☆67Updated 6 years ago
• SponsorPay / jaquet
  Spark stream from kafka(json) to s3(parquet)
  ☆15Updated 6 years ago