Alternatives and similar repositories for pyspark-atlas:

Users that are interested in pyspark-atlas are comparing it to the libraries listed below

• holdenk / high-performance-spark-examples
  Examples for High Performance Spark
  ☆15Updated 4 months ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• ExpediaGroup / shunting-yard
  Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.
  ☆20Updated 3 years ago
• FINRAOS / MegaSparkDiff
  A Spark-based data comparison tool at scale which facilitates software development engineers to compare a plethora of pair combinations o…
  ☆50Updated last year
• avensolutions / cdc-at-scale-using-spark
  Scalable CDC Pattern Implemented using PySpark
  ☆18Updated 5 years ago
• bolcom / hive_compared_bq
  hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.
  ☆28Updated 7 years ago
• vvaks0 / AvroSchemaShredder
  Avro Schema Shredder is a REST API that enables storage of Avro Schemas in Apache Atlas. This API enables an organization to use Apache A…
  ☆13Updated 8 years ago
• ExpediaGroup / circus-train
  Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
  ☆88Updated last year
• sibytes / yetl
  Yet Another (Spark) ETL Framework
  ☆20Updated last year
• maropu / spark-data-repair-plugin
  Provide functionality to build statistical models to repair dirty tabular data in Spark
  ☆12Updated last year
• sparsecode / DaFlow
  Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple…
  ☆26Updated 3 years ago
• zaratsian / HDP_Tuning_Unofficial
  Collection of HDP Tuning Tricks & Tips (unofficial guide)
  ☆17Updated 7 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year
• werneckpaiva / spark-to-tableau
  Spark to Tableau Extractor library
  ☆18Updated 7 years ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• dremio-hub / dremio-flight-connector
  Dremio Flight connector. Access Dremio using Arrow flight
  ☆40Updated 4 years ago
• hortonworks-spark / spark-schema-registry
  Schema Registry integration for Apache Spark
  ☆40Updated 2 years ago
• Chaffelson / whoville
  An opinionated auto-deployer for the Hortonworks Platform
  ☆34Updated 4 years ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• davidgasquez / kubedbt
  📆 Run, schedule, and manage your dbt jobs using Kubernetes.
  ☆24Updated 6 years ago
• bernhard-42 / Spark-ETL-Atlas
  A small project to show how to add lineage to Atlas when using Spark as ETL tool
  ☆12Updated 8 years ago
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆30Updated 4 months ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 5 years ago
• joerg-schneider / airtunnel
  The sane way of building a data layer in Airflow
  ☆24Updated 5 years ago
• ExpediaGroup / apiary
  Apiary provides modules which can be combined to create a federated cloud data lake
  ☆36Updated 11 months ago
• snowflakedb / snowflake-hive-metastore-connector
  ☆14Updated last month
• ing-bank / rokku
  Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…
  ☆66Updated 3 weeks ago
• TristanBilot / airflow-rbac-roles-cli
  A tool to create Airflow RBAC roles with dag-level permissions from cli.
  ☆13Updated last year
• paypal / dione
  Dione - a Spark and HDFS indexing library
  ☆52Updated 11 months ago
• dbt-labs / dbt-presto
  [ARCHIVED] The Presto adapter plugin for dbt Core
  ☆33Updated last year