laudio / airflow-etl-mssql-sample

Related projects: ⓘ

• infinitelambda / prefect-pipeline
  This repository is part of an article "Prefect workflow automation with Azure DevOps and AKS"
  ☆31Updated 3 years ago
• tomaszdudek7 / airflow_project
  scaffold of Apache Airflow executing Docker containers
  ☆85Updated last year
• pybokeh / dagster-sklearn
  dagster scikit-learn pipeline example.
  ☆43Updated last year
• venkatra / dbt_hacks
  A bunch of hacks developed around dbt
  ☆48Updated 4 years ago
• sibytes / yetl
  Yet Another (Spark) ETL Framework
  ☆18Updated 11 months ago
• capitalone / locopy
  locopy: Loading/Unloading to Redshift and Snowflake using Python.
  ☆104Updated last week
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆71Updated last year
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆34Updated last year
• jamesweakley / snowflake-rbgm
  Rules based grant management for Snowflake
  ☆40Updated 5 years ago
• sspaeti-com / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆38Updated 3 years ago
• quantumblacklabs / kedro-airflow
  ☆115Updated this week
• snowflakedb / snowflake-ingest-python
  A Python API for Asynchronously Loading Data into Snowflake DB -
  ☆59Updated last week
• debussy-labs / debussy_concert
  Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and…
  ☆28Updated last year
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆41Updated 2 months ago
• michaelchanwahyan / datalab
  ☆108Updated last year
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 5 years ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 2 years ago
• trevor-higbee / snowflake-tools
  Useful scripts, utilities, and tools for Snowflake
  ☆13Updated 4 years ago
• omidvd79 / Big_Data_Demystified
  Big Data Demystified meetup and blog examples
  ☆31Updated last month
• databrickslabs / feature-factory
  Accelerator to rapidly deploy customized features for your business
  ☆55Updated 9 months ago
• sspaeti-com / awesome-dagster
  A curated list of dagster code snippets for data engineers
  ☆48Updated 6 months ago
• cordon-thiago / spark-schema-merge
  Spark app to merge different schemas
  ☆23Updated 3 years ago
• jaceklaskowski / spark-delta-lake-workshop
  Spark and Delta Lake Workshop
  ☆21Updated 2 years ago
• delta-io / delta-docs
  Delta Lake Documentation
  ☆45Updated 3 months ago
• trallard / airflow-tutorial
  🐍💨 Airflow tutorial for PyCon 2019
  ☆85Updated last year
• sodadata / soda-sql
  Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html
  ☆60Updated last year
• kadnan / Airflow-Tutorial
  Basic tutorial of using Apache Airflow
  ☆35Updated 5 years ago
• astronomer / airflow-example-dags
  Sample Airflow DAGs
  ☆60Updated last year
• jeremiahhansen / snowflake-connector-adf
  An Azure Function which allows Azure Data Factory (ADF) to connect to Snowflake in a flexible way.
  ☆26Updated last year
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated 6 months ago