ynqa / pandavro
Apache Avro <-> pandas DataFrame
☆136Updated 6 months ago
Alternatives and similar repositories for pandavro:
Users that are interested in pandavro are comparing it to the libraries listed below
- pytest plugin to run the tests with support of pyspark☆84Updated 11 months ago
- Pandas ExtensionDType/Array backed by Apache Arrow☆229Updated last year
- Fast iterative local development and testing of Apache Airflow workflows☆196Updated 2 months ago
- Asynchronous actions for PySpark☆47Updated 3 years ago
- Airflow Backfill UI based plugin for existing / new Airflow environment☆66Updated 4 years ago
- Apache (Py)Spark type annotations (stub files).☆115Updated 2 years ago
- Pylint plugin for static code analysis on Airflow code☆93Updated 4 years ago
- ☆198Updated last year
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆260Updated last year
- Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...☆138Updated 3 weeks ago
- A Python client for Apache Livy, enabling use of remote Apache Spark clusters.☆71Updated 3 years ago
- BigQuery backend for Ibis☆19Updated last year
- Deploy dask on YARN clusters☆69Updated 6 months ago
- Command line (CLI) tool to inspect Apache Parquet files on the go☆181Updated last year
- Coming soon☆59Updated last year
- A tool and library for easily deploying applications on Apache YARN☆142Updated 11 months ago
- Astronomer Core Docker Images☆106Updated 8 months ago
- Primrose modeling framework for simple production models☆33Updated 11 months ago
- Amazon Redshift SQLAlchemy Dialect☆221Updated 7 months ago
- Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …☆627Updated this week
- Jupyter kernel for scala and spark☆187Updated last year
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆112Updated 10 months ago
- Docker images for dask☆234Updated this week
- PySpark schema generator☆41Updated last year
- triggering a DAG run multiple times☆86Updated 11 months ago
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆106Updated this week
- Airflow declarative DAGs via YAML☆132Updated last year
- Data Exploration in PySpark made easy - Pyspark_dist_explore provides methods to get fast insights in your Spark DataFrames.☆103Updated 5 years ago
- A Delta Lake reader for Dask☆48Updated 4 months ago
- ☆127Updated 4 years ago