Alternatives and similar repositories for DaFlow

Users that are interested in DaFlow are comparing it to the libraries listed below

• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆52Updated 4 months ago
• maropu / spark-sql-server
  Yet Another Spark SQL JDBC/ODBC server based on the PostgreSQL V3 protocol
  ☆34Updated 3 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆73Updated 4 years ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆29Updated 11 months ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated 2 years ago
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆122Updated this week
• qubole / quark
  Quark is a data virtualization engine over analytic databases.
  ☆100Updated 8 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆76Updated last year
• ZuInnoTe / spark-hadoopoffice-ds
  A Spark datasource for the HadoopOffice library
  ☆37Updated 3 weeks ago
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆51Updated 5 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 6 years ago
• AbsaOSS / spark-hofs
  Scala API for Apache Spark SQL high-order functions
  ☆14Updated 2 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆90Updated last year
• indix / sparkplug
  Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌
  ☆29Updated 5 years ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆62Updated last year
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆182Updated 3 weeks ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• cloudera-labs / envelope
  Build configuration-driven ETL pipelines on Apache Spark
  ☆161Updated 3 years ago
• lightcopy / parquet-index
  Spark SQL index for Parquet tables
  ☆134Updated 4 years ago
• agile-lab-dev / DataQuality
  DataQuality for BigData
  ☆144Updated last year
• avensolutions / cdc-at-scale-using-spark
  Scalable CDC Pattern Implemented using PySpark
  ☆18Updated 2 weeks ago
• phatak-dev / flink-examples
  Flink Examples
  ☆39Updated 9 years ago
• rovio / rovio-ingest
  An implementation of the DatasourceV2 interface of Apache Spark™ for writing Spark Datasets to Apache Druid™.
  ☆43Updated last week
• spoddutur / cloud-based-sql-engine-using-spark
  Cloud-based SQL engine using SPARK where data is accessible as JDBC/ODBC data source via Spark ThriftServer.
  ☆31Updated 8 years ago
• minio / spark-select
  A library for Spark DataFrame using MinIO Select API
  ☆99Updated 6 years ago
• streamnative / pulsar-spark
  Spark Connector to read and write with Pulsar
  ☆116Updated last month
• qubole / spark-acid
  ACID Data Source for Apache Spark based on Hive ACID
  ☆97Updated 4 years ago
• linkedin / iceberg
  A temporary home for LinkedIn's changes to Apache Iceberg (incubating)
  ☆63Updated last week
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆82Updated 3 years ago