Alternatives and similar repositories for delta-architecture

Users that are interested in delta-architecture are comparing it to the libraries listed below

• airbnb / sputnik
  ☆63Updated 6 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆73Updated 4 years ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆108Updated last year
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆52Updated 5 months ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 6 years ago
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆46Updated 4 months ago
• ing-bank / rokku
  Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…
  ☆70Updated 3 months ago
• wepay / kafka-connect-bigquery
  DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigquery. A Kafka Connect BigQuery sink connector
  ☆152Updated last year
• twalthr / flink-api-examples
  Examples for using Apache Flink® with DataStream API, Table API, Flink SQL and connectors such as MySQL, JDBC, CDC, Kafka.
  ☆65Updated 2 years ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆62Updated last year
• Wikia / discreETLy
  ETLy is an add-on dashboard service on top of Apache Airflow.
  ☆68Updated 2 years ago
• qubole / quark
  Quark is a data virtualization engine over analytic databases.
  ☆100Updated 8 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆76Updated last year
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆82Updated 3 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated 2 years ago
• intuit / superglue
  Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …
  ☆159Updated 2 years ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆230Updated last month
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆29Updated last year
• indix / schemer
  Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
  ☆113Updated 5 years ago
• fivetran / benchmark
  Benchmark data warehouses under Fivetran-like conditions
  ☆171Updated 2 years ago
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆100Updated last week
• MrPowers / bebe
  Filling in the Spark function gaps across APIs
  ☆50Updated 4 years ago
• ardlema / kafka-streams-workshop
  ☆67Updated 6 years ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆182Updated last month
• JacekMajchrzak / awesome-datamesh
  ☆97Updated 2 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆91Updated last year
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆123Updated last week
• rambler-digital-solutions / airflow-declarative
  Airflow declarative DAGs via YAML
  ☆133Updated 2 years ago
• rovio / rovio-ingest
  An implementation of the DatasourceV2 interface of Apache Spark™ for writing Spark Datasets to Apache Druid™.
  ☆43Updated last month
• minio / spark-select
  A library for Spark DataFrame using MinIO Select API
  ☆99Updated 6 years ago