Alternatives and similar repositories for spark-hofs

Users that are interested in spark-hofs are comparing it to the libraries listed below

• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆29Updated 10 months ago
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆45Updated 2 months ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆73Updated 4 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆76Updated last year
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆51Updated 5 years ago
• avensolutions / cdc-at-scale-using-spark
  Scalable CDC Pattern Implemented using PySpark
  ☆18Updated 6 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 6 years ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆62Updated last year
• indix / schemer
  Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
  ☆112Updated 5 years ago
• sjwiesman / flink-scala-3
  ☆36Updated 3 years ago
• univalence / spark-tools
  ☆45Updated 5 years ago
• springnz / sparkplug
  A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.
  ☆47Updated 9 years ago
• ing-bank / scruid
  Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.
  ☆115Updated 4 years ago
• indix / sparkplug
  Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌
  ☆29Updated 5 years ago
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆52Updated 3 months ago
• apache / incubator-retired-amaterasu
  Apache Amaterasu
  ☆56Updated 5 years ago
• mayur2810 / sope
  Apache Spark ETL Utilities
  ☆40Updated 11 months ago
• BenFradet / struct-type-encoder
  Deriving Spark DataFrame schemas from case classes
  ☆44Updated last year
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆124Updated last week
• elastacloud / spark-excel
  A Spark data source for reading Microsoft Excel files
  ☆13Updated last year
• sparsecode / DaFlow
  Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…
  ☆26Updated 4 years ago
• streaming-analytics / Styx
  Streaming Analytics platform, built with Apache Flink and Kafka
  ☆34Updated last year
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆100Updated last week
• AbsaOSS / enceladus
  Dynamic Conformance Engine
  ☆32Updated 3 weeks ago
• rovio / rovio-ingest
  An implementation of the DatasourceV2 interface of Apache Spark™ for writing Spark Datasets to Apache Druid™.
  ☆43Updated 2 months ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• laserdisc-io / tamer
  Standalone alternatives to Kafka Connect Connectors
  ☆45Updated this week
• agile-lab-dev / wasp
  WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging …
  ☆31Updated 3 months ago
• maropu / spark-data-repair-plugin
  Provide functionality to build statistical models to repair dirty tabular data in Spark
  ☆12Updated 2 years ago