jamesturk / scrapelibLinks
⛏ a library for scraping unreliable pages
☆212Updated last week
Alternatives and similar repositories for scrapelib
Users that are interested in scrapelib are comparing it to the libraries listed below
Sorting:
- framework for scraping legislative/government data☆89Updated 2 months ago
- Python library with common functionality for writing web scrapers☆102Updated 10 years ago
- legacy backend for Open States☆87Updated 5 years ago
- A tiny library for Python text normalisation. Useful for ad-hoc text processing.☆157Updated 4 months ago
- A modern Python library for writing maintainable web scrapers.☆249Updated last month
- Opinionated template for Django projects on Python 3 and PostgreSQL☆24Updated 8 years ago
- Easy extraction of keywords and engines from search engine results pages (SERPs).☆93Updated 3 months ago
- Parser and standardizer for politician, individual and organization names.☆129Updated 8 years ago
- Utility library to turn country names into ISO two-letter codes☆71Updated 5 months ago
- Tools for parsing messy tabular data. This is now superseded by https://github.com/frictionlessdata/tabulator-py☆392Updated 2 years ago
- ScraperWiki Python library for scraping and saving data; in maintenance mode☆158Updated this week
- Scrapy middleware which allows to crawl only new content☆79Updated last week
- A custom template for initializing a new Django project the Data Desk way.☆12Updated 8 years ago
- Street address parser and formatter☆91Updated 6 years ago
- Now included in rigour☆152Updated last month
- Next-gen web application for public finance data warehouses, formerly OpenSpending☆57Updated 3 years ago
- A tool to allow US addresses to be geocoded/georeferenced easily, without using Python or the command line or paid services or anything.☆18Updated 3 years ago
- Unified Python bindings for Sunlight APIs☆66Updated 9 years ago
- ProPublica's collaborative tip-gathering framework. Import and manage CSV, Google Sheets and Screendoor data with ease.☆100Updated 2 years ago
- PyOpenGraph is a library written in Python for parsing Open Graph protocol information from web sites.☆96Updated 11 years ago
- PANDA: A Newsroom Data Appliance☆208Updated 3 years ago
- A Flask-based static site authoring tool.☆164Updated 3 years ago
- A simple command line interface to the datamade/dedupe library.☆43Updated 3 years ago
- Scrapes sites. Gets news. Eventually events.☆85Updated 9 years ago
- Tools for generating CSV and other flat versions of the structured data☆109Updated last month
- A Python module for accessing the Open States API☆31Updated 2 years ago
- python library for extracting html microdata☆167Updated 2 years ago
- python utilities for Open Civic Data☆37Updated last year
- Python implementation of the Parsley language for extracting structured data from web pages☆92Updated 8 years ago
- Simple type converters: make ints, floats, bools and dates from your strings!☆11Updated 9 years ago