Alternatives and similar repositories for data-mill:

Users that are interested in data-mill are comparing it to the libraries listed below

• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 2 years ago
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆29Updated this week
• bernhard-42 / pyspark-atlas
  PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection
  ☆18Updated 8 years ago
• TIBCOSoftware / snappy-on-k8s
  An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes
  ☆83Updated 5 years ago
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆61Updated 7 months ago
• joshuarobinson / trino-on-k8s
  Setup for running Trino with Hive Metastore on Kubernetes
  ☆101Updated 2 years ago
• PBWebMedia / airflow-prometheus-exporter
  Export Airflow metrics (from mysql) in prometheus format
  ☆29Updated last week
• gtoonstra / databook
  A facebook for data
  ☆26Updated 5 years ago
• lynnlangit / Spark-Scala-EKS
  Spark Scala docker container sample for AWS testing - EKS & S3
  ☆24Updated 6 years ago
• MrPowers / ceja
  PySpark phonetic and string matching algorithms
  ☆39Updated last year
• godatadriven / airflow-helm
  ☆11Updated 5 years ago
• sourav-mazumder / Data-Science-Extensions
  ☆72Updated 4 years ago
• JacekMajchrzak / awesome-datamesh
  ☆96Updated last year
• vvaks0 / AvroSchemaShredder
  Avro Schema Shredder is a REST API that enables storage of Avro Schemas in Apache Atlas. This API enables an organization to use Apache A…
  ☆13Updated 8 years ago
• yodasco / pyspark-emr
  A toolset to streamline running spark python on EMR
  ☆20Updated 8 years ago
• sainib / hadoop-data-pipeline
  Hadoop Data Pipeline using Falcon
  ☆15Updated 8 years ago
• ExpediaGroup / hiveberg
  Demonstration of a Hive Input Format for Iceberg
  ☆26Updated 4 years ago
• ing-bank / rokku
  Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…
  ☆66Updated 2 months ago
• ExpediaGroup / apiary
  Apiary provides modules which can be combined to create a federated cloud data lake
  ☆36Updated last year
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 5 years ago
• h2oai / h2o-kubeflow
  ☆37Updated 5 years ago
• apache-spark-on-k8s / ansible
  Ansible playbooks for Apache Spark on kube
  ☆27Updated 7 years ago
• alopresto / slides
  Presentations and other resources.
  ☆36Updated 4 years ago
• odpi / data-governance
  Egeria's Guidance on Governance as well as large media files such as presentations and movies
  ☆104Updated 2 years ago
• B23admin / nifi-stateless-operator
  An Operator for scheduling and executing NiFi Flows as Jobs on Kubernetes
  ☆53Updated 4 years ago
• joerg-schneider / airtunnel
  The sane way of building a data layer in Airflow
  ☆24Updated 5 years ago
• dataintoresults / data-brewery
  Data Brewery is an ETL (Extract-Transform-Load) program that connect to many data sources (cloud services, databases, ...) and manage dat…
  ☆16Updated 4 years ago
• palantir / spark-influx-sink
  A Spark metrics sink that pushes to InfluxDb
  ☆51Updated 4 years ago
• avensolutions / cdc-at-scale-using-spark
  Scalable CDC Pattern Implemented using PySpark
  ☆18Updated 5 years ago
• knockdata / spark-highcharts
  Support Highcharts in Apache Zeppelin
  ☆81Updated 7 years ago