Alternatives and similar repositories for pramen

Users that are interested in pramen are comparing it to the libraries listed below

• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆30Updated 6 months ago
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆44Updated last year
• AbsaOSS / spark-hats
  Nested array transformation helper extensions for Apache Spark
  ☆37Updated last year
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆59Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆223Updated last month
• AbsaOSS / enceladus
  Dynamic Conformance Engine
  ☆31Updated 4 months ago
• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆94Updated this week
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated last year
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆105Updated 7 months ago
• AbsaOSS / spark-hofs
  Scala API for Apache Spark SQL high-order functions
  ☆14Updated last year
• paypal / dione
  Dione - a Spark and HDFS indexing library
  ☆52Updated last year
• ognis1205 / delta-hub
  A platform and cloud-based service for data sharing based on the Delta Sharing protocol.
  ☆21Updated 11 months ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 5 years ago
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆124Updated this week
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆37Updated 2 weeks ago
• rovio / rovio-ingest
  An implementation of the DatasourceV2 interface of Apache Spark™ for writing Spark Datasets to Apache Druid™.
  ☆41Updated 3 weeks ago
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆101Updated last month
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆188Updated last week
• amundsen-io / amundsengremlin
  Amundsen Gremlin
  ☆21Updated 2 years ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆181Updated last week
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆46Updated last year
• sibytes / yetl
  Yet Another (Spark) ETL Framework
  ☆21Updated last year
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆226Updated 3 months ago
• SaurabhChawla100 / spark-radiant
  Spark-Radiant is Apache Spark Performance and Cost Optimizer
  ☆25Updated 4 months ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 2 years ago
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆184Updated 4 months ago
• kensuio-oss / kensu-py
  Observability Python library - Powered by Kensu
  ☆22Updated 7 months ago
• kaiko-ai / typedspark
  Column-wise type annotations for pyspark DataFrames
  ☆76Updated this week