Alternatives and similar repositories for airflow-scraping:

Users that are interested in airflow-scraping are comparing it to the libraries listed below

• kadnan / Airflow-Tutorial
  Basic tutorial of using Apache Airflow
  ☆36Updated 6 years ago
• dataquestio / analytics_pipeline
  Code to build a simple analytics data pipeline with Python
  ☆102Updated 8 years ago
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆56Updated 3 years ago
• gfelot / DEND-Data_Pipeline_Airflow
  Learn to build a data pipeline with Airflow to automate wrangling data - An Udacity Data Engineer Nano Degree Project
  ☆8Updated 5 years ago
• mdh266 / AirflowETL
  Blog post on ETL pipelines with Airflow
  ☆23Updated 4 years ago
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆87Updated 4 years ago
• tomaszdudek7 / airflow_project
  scaffold of Apache Airflow executing Docker containers
  ☆85Updated 2 years ago
• Sean-Bradley / Stream-Data-From-Flask-To-Postgres
  A tutorial on streaming data from a Flask REST API and streaming the response into PostgreSQL
  ☆39Updated 5 years ago
• florimondmanca / kafka-fraud-detector
  🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python
  ☆86Updated 5 years ago
• josephwibowo / MeetBaeArea
  Airflow ETL for Meetup API
  ☆46Updated 6 years ago
• diljeet1994 / Python_Tutorials
  Python Notes on IPython Notebook files.
  ☆37Updated 4 years ago
• xnuinside / airflow_in_docker_compose
  Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)
  ☆185Updated last year
• feluelle / finance-data-builder
  Finance 🏦 Data Builder 🛠️ @ postgres 🐘
  ☆21Updated 4 years ago
• deliveryhero / pyconde2019-airflow-ml-workshop
  PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.
  ☆47Updated last year
• erood / interviewqs.com_code_snippets
  ☆46Updated 3 years ago
• Postiii / twds-crawler
  Highly scalable webcrawler for towardsdatascience.com by using Python, Selenium, Docker, Kubernetes and the infrastructure of the Google …
  ☆25Updated 3 years ago
• mdh266 / AirflowDataPipeline
  Example of an ETL Pipeline using Airflow
  ☆34Updated 7 years ago
• abhioncbr / docker-airflow
  Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializi…
  ☆32Updated 5 years ago
• akshitvjain / restaurant-finder-featureReviews
  Build a Flask web application to help users retrieve key restaurant information and feature-based reviews (generated by applying market-b…
  ☆22Updated 4 years ago
• trallard / airflow-tutorial
  🐍💨 Airflow tutorial for PyCon 2019
  ☆86Updated 2 years ago
• rileypredum / marketing_analytics_sql
  Analyzing and calculating key marketing metrics with SQL and Python
  ☆14Updated 6 years ago
• susanli2016 / Statistics-with-Python
  ☆26Updated 5 years ago
• h3ik0th / clv
  customer lifetime value BG/NBD model
  ☆17Updated 3 years ago
• BenSchr / Udacity-Data-Engineering-Projects
  My solutions for the Udacity Data Engineering Nanodegree
  ☆33Updated 5 years ago
• anilkulkarni87 / airflow-docker
  This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …
  ☆29Updated last year
• vishalsatam / Data-Pipelining
  ☆26Updated 4 years ago
• dimgold / ETL_with_Python
  ETL with Python - Taught at DWH course 2017 (TAU)
  ☆103Updated 7 years ago
• michaelchanwahyan / datalab
  ☆110Updated 3 months ago
• calebpollman / web-scraping-parallel-processing
  ☆31Updated last year
• ninja-van / airflow-boilerplate
  A complete development environment setup for working with Airflow
  ☆128Updated 2 years ago