Alternatives and similar repositories for cdc-at-scale-using-spark:

Users that are interested in cdc-at-scale-using-spark are comparing it to the libraries listed below

• maropu / spark-data-repair-plugin
  Provide functionality to build statistical models to repair dirty tabular data in Spark
  ☆12Updated last year
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆34Updated 5 months ago
• sparsecode / DaFlow
  Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…
  ☆26Updated 3 years ago
• phatak-dev / spark-3.0-examples
  Examples of Spark 3.0
  ☆47Updated 4 years ago
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆44Updated last year
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆51Updated 4 years ago
• sibytes / yetl
  Yet Another (Spark) ETL Framework
  ☆20Updated last year
• ZuInnoTe / spark-hadoopoffice-ds
  A Spark datasource for the HadoopOffice library
  ☆38Updated 2 years ago
• MrPowers / scalatest-example
  Testing Scala code with scalatest
  ☆12Updated 2 years ago
• avensolutions / spark-sql-etl-framework
  Multi-stage, config driven, SQL based ETL framework using PySpark
  ☆25Updated 5 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated 10 months ago
• holdenk / high-performance-spark-examples
  Examples for High Performance Spark
  ☆15Updated 4 months ago
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆28Updated this week
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆30Updated last month
• mayur2810 / sope
  Apache Spark ETL Utilities
  ☆40Updated 4 months ago
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆50Updated last year
• trinodb / tempto
  A testing framework for Trino
  ☆26Updated this week
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆30Updated 4 months ago
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 5 years ago
• AbsaOSS / spark-hofs
  Scala API for Apache Spark SQL high-order functions
  ☆14Updated last year
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• ExpediaGroup / hiveberg
  Demonstration of a Hive Input Format for Iceberg
  ☆26Updated 4 years ago
• techmonad / spark-data-pipeline
  This project describes how to write full ETL data pipeline using spark.
  ☆15Updated 2 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• bernhard-42 / pyspark-atlas
  PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection
  ☆18Updated 8 years ago
• SaurabhChawla100 / spark-radiant
  Spark-Radiant is Apache Spark Performance and Cost Optimizer
  ☆25Updated 2 months ago
• aravinthsci / Spark_Delta_Lake
  Delta Lake Examples
  ☆12Updated 4 years ago
• pauldeschacht / SparkDataLineageCapture
  Capture the logical plan from Spark (SQL)
  ☆21Updated 4 years ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆61Updated 6 months ago