ynqa / pandavro
Apache Avro <-> pandas DataFrame
☆137Updated 8 months ago
Alternatives and similar repositories for pandavro:
Users that are interested in pandavro are comparing it to the libraries listed below
- pytest plugin to run the tests with support of pyspark☆85Updated this week
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆261Updated last year
- Pylint plugin for static code analysis on Airflow code☆93Updated 4 years ago
- BigQuery backend for Ibis☆19Updated last year
- Pandas ExtensionDType/Array backed by Apache Arrow☆229Updated 2 years ago
- Apache (Py)Spark type annotations (stub files).☆116Updated 2 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆197Updated 3 months ago
- Asynchronous actions for PySpark☆47Updated 3 years ago
- ☆198Updated last year
- A Python client for Apache Livy, enabling use of remote Apache Spark clusters.☆70Updated 3 years ago
- A tool and library for easily deploying applications on Apache YARN☆144Updated last year
- Deploy dask on YARN clusters☆69Updated 7 months ago
- A web frontend for scheduling Jupyter notebook reports☆252Updated 3 months ago
- Dockerized setup for testing code on realistic hadoop clusters☆27Updated 4 years ago
- Airflow Backfill UI based plugin for existing / new Airflow environment☆65Updated 4 years ago
- SQLAlchemy dialect for BigQuery☆448Updated this week
- SQL on dataframes - pandas and dask☆64Updated 6 years ago
- Pythonic file-system interface for Google Cloud Storage☆357Updated this week
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆107Updated last week
- Collection of transforms for the Apache beam python SDK.☆89Updated last year
- Amazon Redshift SQLAlchemy Dialect☆222Updated 8 months ago
- Read Delta tables without any Spark☆47Updated last year
- Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are inst…☆36Updated 4 years ago
- Astronomer Core Docker Images☆106Updated 10 months ago
- Pytest plugin for dbt core☆59Updated 2 months ago
- Make simple storing test results and visualisation of these in a BI dashboard☆42Updated this week
- DBAPI and SQLAlchemy dialect for Databricks Workspace and SQL Analytics clusters☆22Updated 3 years ago
- Docker images for dask☆235Updated last month
- Pipeline definitions for managing data flows to power analytics at MIT Open Learning☆43Updated this week
- A command-line tool for managing permissions and dependencies for BigQuery authorized views☆91Updated 2 years ago