Alternatives and similar repositories for pylivy

Users that are interested in pylivy are comparing it to the libraries listed below

• jcrist / skein
  A tool and library for easily deploying applications on Apache YARN
  ☆144Updated last year
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆117Updated 2 years ago
• GoogleCloudPlatform / oozie-to-airflow
  Oozie Workflow to Airflow DAGs migration tool
  ☆87Updated 4 months ago
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆95Updated 4 years ago
• rambler-digital-solutions / airflow-declarative
  Airflow declarative DAGs via YAML
  ☆133Updated last year
• prestodb / presto-python-client
  Python DB-API client for Presto
  ☆238Updated last year
• krishnan-r / sparkmonitor
  Monitor Apache Spark from Jupyter Notebook
  ☆172Updated 3 years ago
• amundsen-io / amundsendatabuilder
  Data ingestion library for Amundsen to build graph and search index
  ☆205Updated last year
• etsy / boundary-layer
  Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform
  ☆260Updated 2 years ago
• teamclairvoyant / airflow-rest-api-plugin
  A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces
  ☆326Updated 4 years ago
• godatadriven / whirl
  Fast iterative local development and testing of Apache Airflow workflows
  ☆202Updated 3 months ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆228Updated 2 weeks ago
• itsjafer / jupyterlab-sparkmonitor
  JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook
  ☆92Updated 2 years ago
• astronomer / ap-airflow
  Astronomer Core Docker Images
  ☆107Updated last year
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆86Updated 2 months ago
• danielvdende / data-testing-with-airflow
  ☆200Updated last year
• FRosner / drunken-data-quality
  Spark package for checking data quality
  ☆221Updated 5 years ago
• AnkurChoraywal / airflow-backfill-util
  Airflow Backfill UI based plugin for existing / new Airflow environment
  ☆65Updated 4 years ago
• zero323 / pyspark-asyncactions
  Asynchronous actions for PySpark
  ☆47Updated 3 years ago
• teamclairvoyant / airflow-scheduler-failover-controller
  A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability
  ☆235Updated 2 years ago
• criteo / cluster-pack
  A library on top of either pex or conda-pack to make your Python code easily available on a cluster
  ☆45Updated last week
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆226Updated last month
• ms32035 / airflow-dag-dependencies
  Visualize dependencies between Airflow DAGs
  ☆49Updated 4 years ago
• julioasotodv / spark-df-profiling
  Create HTML profiling reports from Apache Spark DataFrames
  ☆196Updated 5 years ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆186Updated 2 years ago
• Lewuathe / docker-trino-cluster
  Multiple node presto cluster on docker container
  ☆124Updated 3 years ago
• dbt-labs / dbt-presto
  [ARCHIVED] The Presto adapter plugin for dbt Core
  ☆33Updated last year
• robinhood / airflow-prometheus-exporter
  Prometheus Exporter for Airflow
  ☆161Updated last year
• amundsen-io / amundsenmetadatalibrary
  Metadata service library for Amundsen
  ☆83Updated 2 weeks ago
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆174Updated 2 months ago