kadnan / airflow-scrapingLinks
Using Apache Airflow to schedule web scrapers
☆42Updated 6 years ago
Alternatives and similar repositories for airflow-scraping
Users that are interested in airflow-scraping are comparing it to the libraries listed below
Sorting:
- Simple alert system implemented in Kafka and Python☆97Updated 7 years ago
- Code to build a simple analytics data pipeline with Python☆102Updated 8 years ago
- Example of an ETL Pipeline using Airflow☆35Updated 7 years ago
- 🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python☆88Updated 6 years ago
- Example DAGs using hooks and operators from Airflow Plugins☆346Updated 7 years ago
- 🐍💨 Airflow tutorial for PyCon 2019☆85Updated 2 years ago
- Code snippets and tools published on the blog at lifearounddata.com☆12Updated 5 years ago
- Blog post on ETL pipelines with Airflow☆23Updated 5 years ago
- ☆26Updated 4 years ago
- A tutorial on streaming data from a Flask REST API and streaming the response into PostgreSQL☆39Updated 5 years ago
- ☆46Updated 3 years ago
- (project & tutorial) dag pipeline tests + ci/cd setup☆88Updated 4 years ago
- ETL with Python - Taught at DWH course 2017 (TAU)☆103Updated 7 years ago
- ☆111Updated 7 months ago
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- Basic tutorial of using Apache Airflow☆36Updated 6 years ago
- A curated list of awesome customer analytics content☆98Updated 7 years ago
- Superset Quick Start Guide, published by Packt☆56Updated last year
- ☆23Updated 6 years ago
- scaffold of Apache Airflow executing Docker containers☆86Updated 2 years ago
- An example program that scrapes data from AllRecipes.com and store in Elasticsearch☆99Updated 7 years ago
- Python Notes on IPython Notebook files.☆37Updated 4 years ago
- A Minimalist End-to-End Scrapy Tutorial☆71Updated 2 years ago
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆186Updated last year
- Code, slides, and documentation for the talks I have given.☆113Updated last month
- 🐳📊🤓Cookiecutter template to launch an awesome dockerized Data Science toolstack (incl. Jupyster, Superset, Postgres, Minio, AirFlow & …☆213Updated 2 years ago
- How to use Python to understand data and transform the data into a tidy format ready to be used for modelling and visualisation.☆36Updated 6 years ago
- Jupyter notebook for scraping and analysis of most in demand job technologies skills for data scientists.☆47Updated 5 years ago
- dbt data models for facebook ads☆40Updated 8 months ago
- A template for a dash applicaiton☆56Updated 2 years ago