kadnan / airflow-scrapingLinks
Using Apache Airflow to schedule web scrapers
☆43Updated 7 years ago
Alternatives and similar repositories for airflow-scraping
Users that are interested in airflow-scraping are comparing it to the libraries listed below
Sorting:
- Example DAGs using hooks and operators from Airflow Plugins☆347Updated 7 years ago
- Code to build a simple analytics data pipeline with Python☆101Updated 8 years ago
- scaffold of Apache Airflow executing Docker containers☆85Updated 3 years ago
- Blog post on ETL pipelines with Airflow☆24Updated 3 months ago
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆185Updated 2 years ago
- A curated list of awesome customer analytics content☆98Updated 8 years ago
- ETL with Python - Taught at DWH course 2017 (TAU)☆102Updated 8 years ago
- Example of an ETL Pipeline using Airflow☆38Updated 8 years ago
- ☆113Updated 11 months ago
- 🐳📊🤓Cookiecutter template to launch an awesome dockerized Data Science toolstack (incl. Jupyster, Superset, Postgres, Minio, AirFlow & …☆215Updated 2 years ago
- (project & tutorial) dag pipeline tests + ci/cd setup☆89Updated 4 years ago
- 🐍💨 Airflow tutorial for PyCon 2019☆87Updated 3 years ago
- A complete development environment setup for working with Airflow☆129Updated 2 years ago
- ☆23Updated 6 years ago
- Simple alert system implemented in Kafka and Python☆95Updated 7 years ago
- Tutorial like code for how to deploy airflow using docker and how to use the DockerOperator.☆44Updated 6 years ago
- Data Pipeline Toolkit for Early-Stage Startups☆43Updated last year
- Data lake, data warehouse on GCP☆57Updated 3 years ago
- A tutorial on streaming data from a Flask REST API and streaming the response into PostgreSQL☆39Updated 6 years ago
- 🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python☆89Updated 6 years ago
- Airflow basics tutorial☆396Updated 4 years ago
- Airflow ETL for Meetup API☆45Updated 6 years ago
- Scraping of LinkedIn Profiles: Creates an Excel file containing the personal data and the last job position of all the provided LinkedIn …☆126Updated 2 years ago
- A tutorial-based introduction to web scraping with Python.☆20Updated 5 years ago
- Basic tutorial of using Apache Airflow☆36Updated 7 years ago
- Singer.io tap for Facebook Marketing API☆116Updated last week
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆89Updated 4 years ago
- ☆179Updated 3 years ago
- Airflow training for the crunch conf☆104Updated 7 years ago
- Python wrapper for Goodreads API☆30Updated 5 years ago