GoogleCloudDataproc / custom-imagesLinks
Tools for creating Dataproc custom images
☆35Updated last month
Alternatives and similar repositories for custom-images
Users that are interested in custom-images are comparing it to the libraries listed below
Sorting:
- Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.☆288Updated last week
- BigQuery Schema Conversion Tool☆23Updated 5 years ago
- Repository with examples and smoke tests for the GCP Airflow operators and hooks☆151Updated 8 years ago
- A curated list of awesome resources for Apache Beam☆145Updated 2 years ago
- Oozie Workflow to Airflow DAGs migration tool☆88Updated 7 months ago
- Cloud Dataproc: Samples and Utils☆205Updated 4 months ago
- BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.☆409Updated last week
- ☆46Updated last year
- Stream Avro SpecificRecord objects in BigQuery using Cloud Dataflow☆13Updated 3 years ago
- ☆54Updated 8 years ago
- hive_compared_bq compares/validates 2 (SQL like) tables, and graphically shows the rows/columns that are different.☆28Updated 7 years ago
- Run in all nodes of your cluster before the cluster starts - lets you customize your cluster☆598Updated last week
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆260Updated 2 years ago
- Solution Accelerators for Serverless Spark on GCP, the industry's first auto-scaling and serverless Spark as a service☆74Updated last year
- Astronomer Core Docker Images☆106Updated last year
- Prometheus Exporter for Airflow☆161Updated last year
- Sample code with integration between Data Catalog and Hive data source.☆24Updated 9 months ago
- Airflow plugin to export dag and task based metrics to Prometheus.☆263Updated 2 weeks ago
- A command-line tool for managing permissions and dependencies for BigQuery authorized views☆91Updated 3 years ago
- Dataproc templates and pipelines for solving in-cloud data tasks☆135Updated this week
- Airflow Unit Tests and Integration Tests☆261Updated 2 years ago
- Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.☆147Updated last year
- Pylint plugin for static code analysis on Airflow code☆96Updated 5 years ago
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- A tutorial on how to get started with Presto.☆56Updated 3 years ago
- Airflow on Kubernetes Operator☆86Updated 2 years ago
- Airflow configuration for Telemetry☆196Updated last week
- An example PySpark project with pytest☆17Updated 8 years ago
- Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes☆485Updated this week
- Kubernetes custom controller and CRDs to managing Airflow☆299Updated 5 years ago