Alternatives and similar repositories for cdc-at-scale-using-spark

Users that are interested in cdc-at-scale-using-spark are comparing it to the libraries listed below

• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆51Updated 5 years ago
• phatak-dev / spark-3.0-examples
  Examples of Spark 3.0
  ☆45Updated 5 years ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 3 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆73Updated 4 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆76Updated last year
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆34Updated last year
• mayur2810 / sope
  Apache Spark ETL Utilities
  ☆39Updated last year
• airbnb / sputnik
  ☆63Updated 6 years ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆62Updated last year
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆61Updated 2 years ago
• AbsaOSS / spark-hofs
  Scala API for Apache Spark SQL high-order functions
  ☆14Updated 2 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 6 years ago
• ansrivas / spark-structured-streaming
  Spark structured streaming with Kafka data source and writing to Cassandra
  ☆63Updated 6 years ago
• hortonworks-spark / cloud-integration
  Spark cloud integration: tests, cloud committers and more
  ☆20Updated last year
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆46Updated 6 months ago
• agile-lab-dev / DataQuality
  DataQuality for BigData
  ☆147Updated 2 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆91Updated last year
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆29Updated last year
• spoddutur / spark-as-service-using-embedded-server
  This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server
  ☆49Updated 2 years ago
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆122Updated this week
• Talend / beam-samples
  ☆81Updated 2 years ago
• hortonworks-spark / spark-hive-streaming-sink
  A sink to save Spark Structured Streaming DataFrame into Hive table
  ☆23Updated 7 years ago
• pauldeschacht / SparkDataLineageCapture
  Capture the logical plan from Spark (SQL)
  ☆22Updated 4 years ago
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆100Updated 2 weeks ago
• tupol / spark-utils
  Basic framework utilities to quickly start writing production ready Apache Spark applications
  ☆36Updated last year
• maropu / spark-sql-server
  Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol
  ☆34Updated 3 years ago
• sutugin / spark-streaming-jdbc-source
  ☆26Updated 4 years ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆230Updated 3 weeks ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆183Updated 4 months ago
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 5 years ago