mozilla / docker-etl

Related projects ⓘ

Alternatives and complementary repositories for docker-etl

• mozilla / python_mozetl
  ETL jobs for Firefox Telemetry
  ☆27Updated 2 months ago
• dbt-labs / spark-utils
  Utility functions for dbt projects running on Spark
  ☆31Updated last year
• mozilla / gcp-ingestion
  Documentation and implementation of telemetry ingestion on Google Cloud Platform
  ☆79Updated this week
• mozilla / lookml-generator
  LookML Generator for Glean and Mozilla Data
  ☆17Updated this week
• googleapis / python-dataproc
  This library has moved to https://github.com/googleapis/google-cloud-python/tree/main/packages/google-cloud-dataproc
  ☆48Updated last year
• microsoft / DataOps
  Example code for doing DataOps
  ☆46Updated 3 years ago
• GoogleCloudPlatform / bq-pii-classifier
  Automatically discover and tag PII data across BigQuery tables and apply column-level access controls based on confidentiality level.
  ☆46Updated 3 weeks ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆42Updated 8 months ago
• astronomer / airflow-testing-guide
  ☆20Updated 3 years ago
• microsoft / dbt-synapse
  dbt adapter for Azure Synapse Dedicated SQL Pools
  ☆70Updated this week
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆38Updated 9 months ago
• delta-io / delta-docs
  Delta Lake Documentation
  ☆46Updated 5 months ago
• reisdebora / awesome-databricks
  A curated list of awesome Databricks resources, including Spark
  ☆14Updated 4 months ago
• googleapis / python-iam
  This library has moved to https://github.com/googleapis/google-cloud-python/tree/main/packages/google-cloud-iam
  ☆37Updated last year
• GoogleCloudPlatform / ci-cd-for-data-processing-workflow
  ☆46Updated 6 months ago
• feluelle / airflint
  Enforce Best Practices for all your Airflow DAGs. ⭐
  ☆92Updated this week
• techindicium / dbt-dag-monitoring
  dbt package for monitoring airflow DAGs and tasks
  ☆29Updated this week
• sodadata / soda-sql
  Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html
  ☆60Updated last year
• infinitelambda / dq-tools
  Make simple storing test results and visualisation of these in a BI dashboard
  ☆40Updated last week
• astronomer / ap-airflow
  Astronomer Core Docker Images
  ☆106Updated 5 months ago
• snowflakedb / snowflake-ingest-python
  A Python API for Asynchronously Loading Data into Snowflake DB -
  ☆60Updated this week
• GoogleCloudPlatform / datacatalog-tag-engine
  Tag Engine automates the process of creating, updating, deleting, and populating metadata in bulk with the Google Cloud services Data Cat…
  ☆49Updated last month
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆44Updated 3 years ago
• zsvoboda / ngods
  New generation opensource data stack
  ☆61Updated 2 years ago
• venkatra / dbt_hacks
  A bunch of hacks developed around dbt
  ☆48Updated 5 years ago
• googleapis / python-error-reporting
  ☆25Updated this week
• SemyonSinchenko / flake8-pyspark-with-column
  A flake8 plugin that detects of usage withColumn in a loop or inside reduce
  ☆21Updated last month
• godatadriven / pytest-dbt-core
  Pytest plugin for dbt core
  ☆58Updated 5 months ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆72Updated last year