public-law / open-gov-crawlersLinks
Parse government documents into well formed JSON
☆72Updated last month
Alternatives and similar repositories for open-gov-crawlers
Users that are interested in open-gov-crawlers are comparing it to the libraries listed below
Sorting:
- A helper library full of URL-related heuristics.☆70Updated 2 weeks ago
- Now included in rigour☆151Updated last week
- Web scraping Page Objects core library☆101Updated 3 weeks ago
- Web grep: search all rendered resources used by a URI☆89Updated last month
- Spider templates for automatic crawlers.☆31Updated 2 months ago
- Page Object pattern for Scrapy☆121Updated 3 weeks ago
- JavaScript support and proxy rotation for Scrapy with ScrapingBee.☆38Updated last year
- A modern Python library for writing maintainable web scrapers.☆249Updated 3 months ago
- API for OpenSanctions with support for entity search and bulk matching of data collections. Supports Reconciliation API spec.☆97Updated last week
- Reading legal authority for the last time☆40Updated 6 months ago
- Software stack with latest Scrapy and updated deps☆65Updated last month
- Zyte Automatic Extraction integration for Scrapy☆56Updated 3 years ago
- Add website scraping abilities to Datasette☆64Updated 2 years ago
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 6 years ago
- Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.☆62Updated this week
- Python clients for Zyte AutoExtract API☆40Updated 3 years ago
- Create a SQLite database containing data from your Pocket account☆107Updated 2 years ago
- Scrape various open data directories to create an index of what's available out there☆37Updated 7 months ago
- Extract text from HTML☆134Updated 5 years ago
- Common interface for data container classes☆68Updated 2 weeks ago
- This Python package can be used to systematically extract multiple data elements (e.g., title, keywords, text) from news sources around t…☆33Updated 2 years ago
- 🕶 Awesome list of Scrapy tools and libraries☆60Updated 5 years ago
- Save an RSS or ATOM feed to a SQLite database☆55Updated 3 weeks ago
- ⛏ a library for scraping unreliable pages☆213Updated 3 weeks ago
- Python wrapper for the MediaWiki API to access and parse data from Wikipedia☆42Updated 2 weeks ago
- A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.☆117Updated last year
- Scripts to make specific datasets cleaner and more convenient☆42Updated 2 years ago
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆146Updated 8 months ago
- The official project website for Datasette☆122Updated 3 months ago
- Scrape HN to track links from specific domains☆64Updated this week