kadnan / airflow-scraping

Related projects ⓘ

Alternatives and complementary repositories for airflow-scraping

• mdh266 / AirflowDataPipeline
  Example of an ETL Pipeline using Airflow
  ☆32Updated 7 years ago
• dataquestio / analytics_pipeline
  Code to build a simple analytics data pipeline with Python
  ☆102Updated 7 years ago
• kadnan / Airflow-Tutorial
  Basic tutorial of using Apache Airflow
  ☆35Updated 6 years ago
• michaelchanwahyan / datalab
  ☆109Updated last year
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆54Updated 2 years ago
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆85Updated 3 years ago
• trallard / airflow-tutorial
  🐍💨 Airflow tutorial for PyCon 2019
  ☆85Updated last year
• mdh266 / AirflowETL
  Blog post on ETL pipelines with Airflow
  ☆23Updated 4 years ago
• erood / interviewqs.com_code_snippets
  ☆46Updated 2 years ago
• gfelot / DEND-Data_Pipeline_Airflow
  Learn to build a data pipeline with Airflow to automate wrangling data - An Udacity Data Engineer Nano Degree Project
  ☆8Updated 5 years ago
• sungchun12 / serverless-data-pipeline-gcp
  Schedule a data pipeline in Google Cloud using cloud function, BigQuery, cloud storage, cloud scheduler, stack trace, cloud build, and p…
  ☆26Updated 5 years ago
• danclark5 / pytesting_db
  Sample pytest tests for testing SQL Server assests.
  ☆45Updated 6 years ago
• bwiley1 / pandleau
  A quick and easy way to convert a Pandas DataFrame to a Tableau .hyper or .tde extract.
  ☆61Updated 4 years ago
• abhioncbr / docker-airflow
  Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializi…
  ☆32Updated 5 years ago
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 6 years ago
• dimgold / ETL_with_Python
  ETL with Python - Taught at DWH course 2017 (TAU)
  ☆101Updated 7 years ago
• deliveryhero / pyconde2019-airflow-ml-workshop
  PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.
  ☆46Updated last year
• konosp / dbt-airflow-docker-compose
  Execution of DBT models using Apache Airflow through Docker Compose
  ☆113Updated last year
• nirupamaprv / Analyze-AB-test-Results
  E-Commerce Website A/B testing: Recommend which of two landing pages to keep based on A/B testing
  ☆24Updated 6 years ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆166Updated last year
• tomaszdudek7 / airflow_project
  scaffold of Apache Airflow executing Docker containers
  ☆85Updated last year
• mikeghen / airflow-tutorial
  Use Airflow to move data from multiple MySQL databases to BigQuery
  ☆99Updated 4 years ago
• rileypredum / marketing_analytics_sql
  Analyzing and calculating key marketing metrics with SQL and Python
  ☆14Updated 5 years ago
• PacktPublishing / Superset-Quick-Start-Guide
  Superset Quick Start Guide, published by Packt
  ☆55Updated 8 months ago
• PacktPublishing / Amazon-Redshift-Cookbook
  Amazon Redshift Cookbook, Published by Packt
  ☆15Updated last year
• soumilshah1995 / Airflow-Tutorials-
  Airflow Tutorials
  ☆24Updated 3 years ago
• omidvd79 / Big_Data_Demystified
  Big Data Demystified meetup and blog examples
  ☆31Updated 3 months ago
• Atreya22 / luigi_rosmann_sales
  Using Luigi to create a Machine Learning Pipeline using the Rossman Sales data from Kaggle
  ☆33Updated 8 years ago
• daddydrac / PySpark-Confluent-Kafka-Apache-Drill-
  A code-based tutorial for production level data streaming with PySpark plus Optimus for data cleaning, Confluent Kafka, & Apache Drill u…
  ☆26Updated 5 years ago