Alternatives and similar repositories for pyspark-test

Users that are interested in pyspark-test are comparing it to the libraries listed below

• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆97Updated 5 years ago
• pipeline-tools / gusty
  Making DAG construction easier
  ☆283Updated last month
• swan-cern / sparkmonitor
  An extension for Jupyter Lab & Jupyter Notebook to monitor Apache Spark (pyspark) from notebooks
  ☆55Updated 2 weeks ago
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆88Updated 8 months ago
• astronomer / astronomer-providers
  Airflow Providers containing Deferrable Operators & Sensors from Astronomer
  ☆149Updated 2 weeks ago
• feluelle / airflint
  Enforce Best Practices for all your Airflow DAGs. ⭐
  ☆108Updated 2 weeks ago
• itsjafer / jupyterlab-sparkmonitor
  JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook
  ☆92Updated 3 years ago
• CybercentreCanada / jupyterlab-sql-editor
  A JupyterLab extension providing, SQL formatter, auto-completion, syntax highlighting, Spark SQL and Trino
  ☆93Updated this week
• astronomer / ap-airflow
  Astronomer Core Docker Images
  ☆105Updated last year
• getindata / kedro-kubeflow
  Kedro Plugin to support running workflows on Kubeflow Pipelines
  ☆57Updated 7 months ago
• databand-ai / dbnd
  DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.
  ☆268Updated 10 months ago
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆347Updated last year
• great-expectations / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆170Updated last week
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆118Updated 2 weeks ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆232Updated 2 weeks ago
• FurcyPin / bigquery-frame
  ☆47Updated last year
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆45Updated 2 years ago
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆118Updated 3 years ago
• getindata / data-pipelines-cli
  CLI for data platform
  ☆20Updated 2 months ago
• acroz / pylivy
  A Python client for Apache Livy, enabling use of remote Apache Spark clusters.
  ☆70Updated 4 years ago
• ms32035 / airflow-dag-dependencies
  Visualize dependencies between Airflow DAGs
  ☆49Updated 4 years ago
• godatadriven / whirl
  Fast iterative local development and testing of Apache Airflow workflows
  ☆204Updated last month
• infinitelambda / dq-tools
  Make simple storing test results and visualisation of these in a BI dashboard
  ☆52Updated last month
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆78Updated 2 years ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆48Updated last year
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆226Updated this week
• sodadata / soda-sql
  Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html
  ☆62Updated 3 years ago
• Ark-kun / google_cloud_mlflow
  Experimental MLflow plugin for Google Cloud Vertex AI
  ☆38Updated 8 months ago
• tiburon-security / jupyterlab_scheduler
  Jupyter Lab Plugin for scheduling recurring execution of files within the UI using Cron
  ☆24Updated 3 years ago