Alternatives and similar repositories for spark-hofs:

Users that are interested in spark-hofs are comparing it to the libraries listed below

• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆30Updated 4 months ago
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆44Updated last year
• AbsaOSS / enceladus
  Dynamic Conformance Engine
  ☆31Updated 3 months ago
• rovio / rovio-ingest
  An implementation of the DatasourceV2 interface of Apache Spark™ for writing Spark Datasets to Apache Druid™.
  ☆41Updated 6 months ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• ExpediaGroup / jasvorno
  A library for strong, schema based conversion between 'natural' JSON documents and Avro
  ☆18Updated last year
• sjwiesman / flink-scala-3
  ☆36Updated 2 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• BenFradet / struct-type-encoder
  Deriving Spark DataFrame schemas from case classes
  ☆44Updated 9 months ago
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆51Updated 4 years ago
• avensolutions / cdc-at-scale-using-spark
  Scalable CDC Pattern Implemented using PySpark
  ☆18Updated 5 years ago
• univalence / spark-tools
  ☆45Updated 4 years ago
• lightbend / kafka-streams-query
  Library offering http based query on top of Kafka Streams Interactive Queries
  ☆69Updated 2 years ago
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆30Updated this week
• pluralsight / hydra-spark
  ☆50Updated 4 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 5 years ago
• sparsecode / DaFlow
  Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…
  ☆26Updated 3 years ago
• springnz / sparkplug
  A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster.
  ☆47Updated 8 years ago
• indix / sparkplug
  Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌
  ☆28Updated 4 years ago
• tharwaninitin / etlflow
  EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for running complex Auditable workflows which can interact with Goo…
  ☆44Updated 7 months ago
• agile-lab-dev / darwin
  Avro Schema Evolution made easy
  ☆34Updated last year
• lensesio / lenses-jdbc
  Lenses.io JDBC driver for Apache Kafka
  ☆21Updated 3 years ago
• qubole / streaminglens
  Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines
  ☆17Updated 5 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated 11 months ago
• maropu / spark-data-repair-plugin
  Provide functionality to build statistical models to repair dirty tabular data in Spark
  ☆12Updated last year
• qubole / spark-state-store
  Rocksdb state storage implementation for Structured Streaming.
  ☆17Updated 4 years ago
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆50Updated last year
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆105Updated 6 months ago
• artur-tamazian / avro-schema-generator
  Library for generating avro schema files (.avsc) based on DB tables structure
  ☆50Updated 3 months ago