ynqa / pandavro

Related projects ⓘ

Alternatives and complementary repositories for pandavro

• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆85Updated 8 months ago
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆90Updated 4 years ago
• dask / dask-yarn
  Deploy dask on YARN clusters
  ☆69Updated 3 months ago
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆115Updated 2 years ago
• godatadriven / whirl
  Fast iterative local development and testing of Apache Airflow workflows
  ☆193Updated 5 months ago
• xhochy / fletcher
  Pandas ExtensionDType/Array backed by Apache Arrow
  ☆229Updated last year
• jcrist / skein
  A tool and library for easily deploying applications on Apache YARN
  ☆142Updated 8 months ago
• acroz / pylivy
  A Python client for Apache Livy, enabling use of remote Apache Spark clusters.
  ☆70Updated 2 years ago
• danielvdende / data-testing-with-airflow
  ☆196Updated last year
• AnkurChoraywal / airflow-backfill-util
  Airflow Backfill UI based plugin for existing / new Airflow environment
  ☆66Updated 3 years ago
• etsy / boundary-layer
  Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform
  ☆262Updated last year
• chhantyal / parquet-cli
  Command line (CLI) tool to inspect Apache Parquet files on the go
  ☆175Updated last year
• svenkreiss / pysparkling
  A pure Python implementation of Apache Spark's RDD and DStream interfaces.
  ☆262Updated 2 months ago
• dask / dask-docker
  Docker images for dask
  ☆232Updated last week
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated 8 months ago
• ms32035 / airflow-dag-dependencies
  Visualize dependencies between Airflow DAGs
  ☆49Updated 3 years ago
• mastak / airflow_multi_dagrun
  triggering a DAG run multiple times
  ☆85Updated 8 months ago
• kawadia / pyspark.test
  Example unit tests for Apache Spark Python scripts using the py.test framework
  ☆85Updated 8 years ago
• jrderuiter / airflow-fs
  Composable filesystem hooks and operators for Apache Airflow.
  ☆17Updated 3 years ago
• dask / dask-cloudprovider
  Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...
  ☆134Updated last month
• capitalone / locopy
  locopy: Loading/Unloading to Redshift and Snowflake using Python.
  ☆104Updated this week
• astronomer / ap-airflow
  Astronomer Core Docker Images
  ☆106Updated 5 months ago
• ibis-project / ibis-bigquery
  BigQuery backend for Ibis
  ☆19Updated last year
• JDASoftwareGroup / kartothek
  A consistent table management library in python
  ☆161Updated last year
• MarquezProject / marquez-airflow
  Airflow support for Marquez
  ☆32Updated 3 years ago
• jcrobak / parquet-python
  python implementation of the parquet columnar file format.
  ☆341Updated 3 years ago
• julioasotodv / spark-df-profiling
  Create HTML profiling reports from Apache Spark DataFrames
  ☆195Updated 4 years ago
• dbt-labs / dbt-presto
  [ARCHIVED] The Presto adapter plugin for dbt Core
  ☆33Updated 11 months ago
• tkp-archive / paperboy
  A web frontend for scheduling Jupyter notebook reports
  ☆251Updated 2 years ago