Alternatives and similar repositories for pyspark-atlas

Users that are interested in pyspark-atlas are comparing it to the libraries listed below

• joerg-schneider / airtunnel
  The sane way of building a data layer in Airflow
  ☆24Updated 5 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆88Updated last year
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• BigDataBoutique / presto-cloud-deploy
  Deploy Presto on the cloud easily, using Terraform and Packer
  ☆45Updated 2 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆59Updated last year
• dbt-labs / dbt-presto
  [ARCHIVED] The Presto adapter plugin for dbt Core
  ☆33Updated last year
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆51Updated 3 weeks ago
• ExpediaGroup / shunting-yard
  Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.
  ☆20Updated 3 years ago
• ExpediaGroup / apiary
  Apiary provides modules which can be combined to create a federated cloud data lake
  ☆36Updated last year
• Wikia / discreETLy
  ETLy is an add-on dashboard service on top of Apache Airflow.
  ☆69Updated last year
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 5 years ago
• amundsen-io / amundsengremlin
  Amundsen Gremlin
  ☆21Updated 2 years ago
• intuit / superglue
  Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …
  ☆157Updated 2 years ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆73Updated 4 years ago
• randerzander / r-service
  Ambari Service definition for deploying R & RHadoop libraries
  ☆18Updated 9 years ago
• data-mill-cloud / data-mill
  A K8s-based infrastructure for analytics
  ☆24Updated 5 years ago
• KeithSSmith / spark-compaction
  File compaction tool that runs on top of the Spark framework.
  ☆59Updated 6 years ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• ExpediaGroup / hiveberg
  Demonstration of a Hive Input Format for Iceberg
  ☆26Updated 4 years ago
• atlassian / themis
  Autoscaling EMR clusters and Kinesis streams on Amazon Web Services (AWS)
  ☆47Updated last year
• avensolutions / cdc-at-scale-using-spark
  Scalable CDC Pattern Implemented using PySpark
  ☆18Updated 6 years ago
• zaratsian / HDP_Tuning_Unofficial
  Collection of HDP Tuning Tricks & Tips (unofficial guide)
  ☆17Updated 7 years ago
• hortonworks-spark / cloud-integration
  Spark cloud integration: tests, cloud committers and more
  ☆19Updated 5 months ago
• holdenk / high-performance-spark-examples
  Examples for High Performance Spark
  ☆16Updated 8 months ago
• tubular / sparkly
  Helpers & syntactic sugar for PySpark.
  ☆62Updated 2 years ago
• snowplow / data-models
  ⚠️ MAINTENANCE-ONLY MODE: Snowplow maintained SQL data models for working with Snowplow web and mobile behavioral data.
  ☆42Updated 6 months ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 6 years ago
• bernhard-42 / Spark-ETL-Atlas
  A small project to show how to add lineage to Atlas when using Spark as ETL tool
  ☆12Updated 8 years ago
• dremio-hub / dremio-flight-connector
  Dremio Flight connector. Access Dremio using Arrow flight
  ☆40Updated 4 years ago
• davidgasquez / kubedbt
  📆 Run, schedule, and manage your dbt jobs using Kubernetes.
  ☆24Updated 6 years ago