szelenka / prefect-webscraper-example
Quick and dirty example of using Prefect Core to scrape a website
☆23Updated 5 years ago
Alternatives and similar repositories for prefect-webscraper-example:
Users that are interested in prefect-webscraper-example are comparing it to the libraries listed below
- A python client library for the Stitch Import API☆42Updated last year
- A fully-featured multi-source data pipeline for continuously extracting knowledge from COVID-19 data.☆21Updated 3 years ago
- A Python library to generate static data catalog sites. Carte scrapes metadata from your data assets and generates a fully searchable fro…☆27Updated 2 years ago
- ☆16Updated 7 months ago
- A maximum-strength name parser for record linkage.☆36Updated last month
- This repository is part of an article "Prefect workflow automation with Azure DevOps and AKS"☆31Updated 4 years ago
- Scrape various open data directories to create an index of what's available out there☆36Updated last month
- SQL-based transforms compatible with Rasgo and PyRasgo☆24Updated 11 months ago
- ☆11Updated 4 months ago
- A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …☆21Updated 2 years ago
- A financial disclosure data extraction tool.☆15Updated last year
- A collection of python utility functions☆11Updated 9 months ago
- Ibis analytics, with Ibis (and more!)☆21Updated 6 months ago
- python script to ingest a csv and convert it to the flare.json format used by many D3.js visualizations☆20Updated 11 months ago
- A Plotly Dash application to interact with the API endpoints of openFDA☆22Updated 4 years ago
- dbt data models for facebook ads☆39Updated 3 months ago
- ETL of newspaper article keywords using Apache Airflow, Newspaper3k, Quilt T4 and AWS S3☆16Updated last week
- Run streamlit web application, test and deploy to a cloud service (GCP, AWS, Heroku)☆14Updated 2 years ago
- A dbt package designed to help SQL based analysis of graphs