GoogleCloudDataproc / custom-imagesLinks
Tools for creating Dataproc custom images
☆33Updated 2 weeks ago
Alternatives and similar repositories for custom-images
Users that are interested in custom-images are comparing it to the libraries listed below
Sorting:
- Sample code with integration between Data Catalog and Hive data source.☆24Updated 4 months ago
- hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.☆28Updated 7 years ago
- Solution Accelerators for Serverless Spark on GCP, the industry's first auto-scaling and serverless Spark as a service☆68Updated last year
- ☆47Updated last year
- Cloud Spanner Connector for Apache Spark☆17Updated 4 months ago
- ☆54Updated 7 years ago
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- An example PySpark project with pytest☆16Updated 7 years ago
- Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub☆37Updated 7 years ago
- A tool to create Airflow RBAC roles with dag-level permissions from cli.☆13Updated last year
- Magic to help Spark pipelines upgrade☆35Updated 8 months ago
- Cloud Dataproc: Samples and Utils☆203Updated this week
- Repository with examples and smoke tests for the GCP Airflow operators and hooks☆148Updated 8 years ago
- Spark pipelines that correspond to a series of Dataflow examples.☆27Updated 6 years ago
- Stream Avro SpecificRecord objects in BigQuery using Cloud Dataflow☆13Updated 3 years ago
- Sample code with integration between Data Catalog and BI data sources.☆32Updated 3 years ago
- Spark on Kubernetes using Helm☆34Updated 4 years ago
- Astronomer Core Docker Images☆107Updated last year
- ☆31Updated 6 years ago
- Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP☆92Updated 9 months ago
- ☕⛵WIP PySpark dependency management☆22Updated 6 years ago
- Apache Beam examples for running on Google Cloud Dataflow.☆30Updated 6 years ago
- A Python package to centralize some Google Cloud Data Catalog scripts, this repo contains commands like bulk CSV operations that help lev…☆22Updated 2 years ago
- This library has moved to https://github.com/googleapis/google-cloud-python/tree/main/packages/google-cloud-dataproc☆48Updated last year
- Data Catalog Tag Templates☆30Updated 3 weeks ago
- Visualize dependencies between Airflow DAGs☆49Updated 4 years ago
- ☆14Updated 3 months ago
- Examples for High Performance Spark☆15Updated 7 months ago
- Pylint plugin for static code analysis on Airflow code☆95Updated 4 years ago
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆18Updated 8 years ago