Alternatives and similar repositories for datapill

Users that are interested in datapill are comparing it to the libraries listed below

• airbnb / sputnik
  ☆63Updated 6 years ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆232Updated 3 weeks ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆76Updated last year
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆34Updated last year
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆61Updated 2 years ago
• getindata / doge-datagen
  ☆19Updated 3 years ago
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆100Updated this week
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆235Updated 11 months ago
• getindata / kafka-connect-iceberg-sink
  ☆81Updated 8 months ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆107Updated last year
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆193Updated last week
• decodableco / dbt-decodable
  A dbt adapter for Decodable
  ☆12Updated 4 months ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 3 years ago
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆187Updated last month
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 5 years ago
• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆97Updated this week
• getindata / dbt-flink-adapter
  Adapter for dbt that executes dbt pipelines on Apache Flink
  ☆96Updated last year
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆72Updated 3 years ago
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆123Updated this week
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆131Updated this week
• polyzos / stream-processing-with-apache-flink
  ☆64Updated last year
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆29Updated last year
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆82Updated 3 years ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆94Updated 8 months ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 6 years ago
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆42Updated last year
• manuzhang / awesome-lakehouse
  a curated list of awesome lakehouse frameworks, applications, etc
  ☆37Updated last month
• JahstreetOrg / spark-on-kubernetes-docker
  Spark on Kubernetes infrastructure Docker images repo
  ☆38Updated 3 years ago
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆346Updated last year
• sbakiu / kubeflow-spark
  Orchestrate Spark Jobs from Kubeflow Pipelines and poll for the status.
  ☆52Updated 3 years ago