Alternatives and similar repositories for cdc-at-scale-using-spark

Users that are interested in cdc-at-scale-using-spark are comparing it to the libraries listed below

• phatak-dev / spark-3.0-examples
  Examples of Spark 3.0
  ☆47Updated 4 years ago
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆52Updated 4 years ago
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆44Updated last week
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆61Updated 8 months ago
• snowflakedb / snowflake-hive-metastore-connector
  ☆14Updated 3 months ago
• maropu / spark-data-repair-plugin
  Provide functionality to build statistical models to repair dirty tabular data in Spark
  ☆12Updated 2 years ago
• dmatrix / examples
  These are some code examples
  ☆55Updated 5 years ago
• mayur2810 / sope
  Apache Spark ETL Utilities
  ☆40Updated 7 months ago
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 5 years ago
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆30Updated 7 months ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 5 years ago
• MrPowers / scalatest-example
  Testing Scala code with scalatest
  ☆12Updated 2 years ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆35Updated 8 months ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆59Updated last year
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆51Updated last year
• Neuw84 / structured-streaming-avro-demo
  Spark 3.0.0 Structured Streaming Kafka Avro Demo
  ☆15Updated 2 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated last year
• SaurabhChawla100 / spark-radiant
  Spark-Radiant is Apache Spark Performance and Cost Optimizer
  ☆25Updated 5 months ago
• sparsecode / DaFlow
  Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…
  ☆26Updated 3 years ago
• saikrishnapujari / Spark-Nested-Data-Parser
  Nested Data (JSON/AVRO/XML) Parsing and Flattening in Spark
  ☆16Updated last year
• pauldeschacht / SparkDataLineageCapture
  Capture the logical plan from Spark (SQL)
  ☆21Updated 4 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• hortonworks-spark / spark-hive-streaming-sink
  A sink to save Spark Structured Streaming DataFrame into Hive table
  ☆23Updated 7 years ago
• hortonworks-spark / cloud-integration
  Spark cloud integration: tests, cloud committers and more
  ☆19Updated 4 months ago
• holdenk / high-performance-spark-examples
  Examples for High Performance Spark
  ☆15Updated 7 months ago
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 4 years ago
• qubole / spark-state-store
  Rocksdb state storage implementation for Structured Streaming.
  ☆17Updated 4 years ago
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆29Updated last week