Alternatives and similar repositories for pyspark_xray

Users that are interested in pyspark_xray are comparing it to the libraries listed below

• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• cordon-thiago / spark-schema-merge
  Spark app to merge different schemas
  ☆23Updated 4 years ago
• justhackit / spark-utils
  ☆10Updated 3 years ago
• MrPowers / gill
  An example PySpark project with pytest
  ☆16Updated 7 years ago
• shlin168 / airflow-event-plugins
  event-triggered plugins for airflow
  ☆21Updated 5 years ago
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 5 years ago
• dimajix / spark-training
  Repository used for Spark Trainings
  ☆53Updated 2 years ago
• bmizhen / rec-avro
  Avro schema and data converters supporting storing arbitrary nested python data structures.
  ☆18Updated 10 months ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 2 years ago
• capitalone / locopy
  locopy: Loading/Unloading to Redshift and Snowflake using Python.
  ☆110Updated this week
• holdenk / high-performance-spark-examples
  Examples for High Performance Spark
  ☆16Updated 8 months ago
• vivek-bombatkar / Spark-with-Python---My-learning-notes-
  ETL pipeline using pyspark (Spark - Python)
  ☆117Updated 5 years ago
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆86Updated last month
• Pushkr / Apache-Spark-Hands-On
  Educational notes,Hands on problems w/ solutions for hadoop ecosystem
  ☆87Updated 6 years ago
• NAVEENKUMARMURUGAN / Pyspark-ETL-Framework
  ☆14Updated 6 years ago
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆117Updated 2 years ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆35Updated 9 months ago
• MrPowers / ceja
  PySpark phonetic and string matching algorithms
  ☆39Updated last year
• nteract / coffee_boat
  ☕⛵WIP PySpark dependency management
  ☆22Updated 7 years ago
• MrPowers / beavis
  Pandas helper functions
  ☆31Updated 2 years ago
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• rambler-digital-solutions / airflow-declarative
  Airflow declarative DAGs via YAML
  ☆132Updated last year
• soyelherein / pyspark-cicd-template
  PySpark data-pipeline testing and CICD
  ☆28Updated 4 years ago
• Nordstrom / bigdata-profiler
  Profiles the data, validates the schema and runs data quality checks and produces a report
  ☆20Updated 6 years ago
• godatadriven / iterative-broadcast-join
  The iterative broadcast join example code.
  ☆70Updated 7 years ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆226Updated last month
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆71Updated 3 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆71Updated 6 years ago
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆174Updated last month