Alternatives and similar repositories for pylivy

Users that are interested in pylivy are comparing it to the libraries listed below

• jcrist / skein
  A tool and library for easily deploying applications on Apache YARN
  ☆144Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆229Updated last month
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆117Updated 3 years ago
• rambler-digital-solutions / airflow-declarative
  Airflow declarative DAGs via YAML
  ☆133Updated last year
• krishnan-r / sparkmonitor
  Monitor Apache Spark from Jupyter Notebook
  ☆172Updated 3 years ago
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆87Updated 3 months ago
• godatadriven / whirl
  Fast iterative local development and testing of Apache Airflow workflows
  ☆201Updated 3 weeks ago
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆95Updated 4 years ago
• etsy / boundary-layer
  Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform
  ☆260Updated 2 years ago
• teamclairvoyant / airflow-rest-api-plugin
  A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces
  ☆326Updated 4 years ago
• danielvdende / data-testing-with-airflow
  ☆201Updated last year
• criteo / cluster-pack
  A library on top of either pex or conda-pack to make your Python code easily available on a cluster
  ☆45Updated this week
• FRosner / drunken-data-quality
  Spark package for checking data quality
  ☆221Updated 5 years ago
• amundsen-io / amundsendatabuilder
  Data ingestion library for Amundsen to build graph and search index
  ☆204Updated last year
• dbt-labs / dbt-presto
  [ARCHIVED] The Presto adapter plugin for dbt Core
  ☆33Updated last year
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆344Updated last year
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated 2 years ago
• robinhood / airflow-prometheus-exporter
  Prometheus Exporter for Airflow
  ☆161Updated last year
• astronomer / ap-airflow
  Astronomer Core Docker Images
  ☆107Updated last year
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆184Updated 2 years ago
• zero323 / pyspark-asyncactions
  Asynchronous actions for PySpark
  ☆47Updated 3 years ago
• teamclairvoyant / airflow-scheduler-failover-controller
  A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability
  ☆235Updated 3 years ago
• swan-cern / sparkmonitor
  An extension for Jupyter Lab & Jupyter Notebook to monitor Apache Spark (pyspark) from notebooks
  ☆55Updated 2 months ago
• dask / dask-yarn
  Deploy dask on YARN clusters
  ☆69Updated last year
• airbnb / sputnik
  ☆63Updated 5 years ago
• itsjafer / jupyterlab-sparkmonitor
  JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook
  ☆92Updated 2 years ago
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆175Updated 3 months ago
• ktrueda / parquet-tools
  easy install parquet-tools
  ☆182Updated last year
• julioasotodv / spark-df-profiling
  Create HTML profiling reports from Apache Spark DataFrames
  ☆196Updated 5 years ago
• AnkurChoraywal / airflow-backfill-util
  Airflow Backfill UI based plugin for existing / new Airflow environment
  ☆65Updated 4 years ago