marclamberti / webinar-airflow-chart

Related projects ⓘ

Alternatives and complementary repositories for webinar-airflow-chart

• TomLous / medium-spark-k8s
  Spark on Kubernetes using Helm
  ☆34Updated 4 years ago
• astronomer / airflow-testing-guide
  ☆20Updated 3 years ago
• delta-io / delta-docs
  Delta Lake Documentation
  ☆46Updated 5 months ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆163Updated last week
• soyelherein / pyspark-cicd-template
  PySpark data-pipeline testing and CICD
  ☆28Updated 4 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆40Updated last week
• borjavb / dbt-iceberg-poc
  ☆66Updated last month
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆44Updated 3 years ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆72Updated last year
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆50Updated 3 months ago
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆38Updated 9 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆207Updated last month
• marclamberti / airflow-materials-aws
  Materials for the next course
  ☆22Updated last year
• developer-advocacy-dremio / quick-guides-from-dremio
  Quick Guides from Dremio on Several topics
  ☆64Updated 3 weeks ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆22Updated 2 months ago
• garystafford / streaming-sales-generator
  Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python
  ☆44Updated last year
• PacktPublishing / Data-Engineering-with-Apache-Spark-Delta-Lake-and-Lakehouse
  Data Engineering with Spark and Delta Lake
  ☆89Updated last year
• sbakiu / kubeflow-spark
  Orchestrate Spark Jobs from Kubeflow Pipelines and poll for the status.
  ☆52Updated 2 years ago
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆62Updated last month
• sibytes / yetl
  Yet Another (Spark) ETL Framework
  ☆18Updated last year
• victorcouste / trino-dbt-demo
  Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database
  ☆70Updated 3 years ago
• Datavault-UK / automate-dv-demo
  An example dbt project using AutomateDV to create a Data Vault 2.0 Data Warehouse based on the Snowflake TPC-H dataset.
  ☆41Updated 7 months ago
• velascoluis / dbt-ci-cd-gke
  CICD pipeline that deploys a dbt image on a GKE cluster
  ☆11Updated 3 years ago
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆43Updated 9 months ago
• testdrivenio / spark-kubernetes
  spark on kubernetes
  ☆105Updated last year
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆34Updated 2 years ago