public-law / open-gov-crawlers
Parse government documents into well formed JSON
☆68Updated 2 months ago
Alternatives and similar repositories for open-gov-crawlers:
Users that are interested in open-gov-crawlers are comparing it to the libraries listed below
- Zyte Automatic Extraction integration for Scrapy☆56Updated 3 years ago
- Reading legal authority for the last time☆37Updated last month
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 5 years ago
- Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.☆57Updated last week
- A helper library full of URL-related heuristics.☆69Updated last month
- World legal info: scraped, organized, and permissively licensed under Creative Commons.☆17Updated 2 weeks ago
- Add website scraping abilities to Datasette☆62Updated 2 years ago
- Software stack with latest Scrapy and updated deps☆64Updated 2 months ago
- A financial disclosure data extraction tool.☆16Updated last year
- Dataset: BuzzFeed News “Trending” Strip, 2018–2023☆19Updated last year
- Extract text from HTML☆135Updated 4 years ago
- Scrape various open data directories to create an index of what's available out there☆36Updated 2 months ago
- Scraping Assisted by Learning☆35Updated last week
- Page Object pattern for Scrapy☆121Updated 2 months ago
- A middleware layer for Scrapy that detects CAPTCHA tests and solves them☆45Updated last year
- Python clients for Zyte AutoExtract API☆40Updated 3 years ago
- Scripts to make specific datasets cleaner and more convenient☆41Updated 2 years ago
- A database of court reporters, tests and other experiments☆105Updated 2 weeks ago
- Scrapy middleware which allows to crawl only new content☆80Updated 2 years ago
- A maximum-strength name parser for record linkage.☆36Updated 3 weeks ago
- Datasette plugin providing instructions for exporting data to Jupyter or Observable☆12Updated last year
- Support for writing WARC files with Scrapy☆21Updated 5 years ago
- Datasette plugin providing data dashboards from metadata☆145Updated 3 weeks ago
- Scrapers for US municipal governments.☆10Updated last year
- Save an RSS or ATOM feed to a SQLite database☆50Updated 2 years ago
- Data cleaning and validation functions for names, languages, identifiers, etc.☆19Updated this week
- how hard is it to get a list of all local news sites in the United States (LOL)☆8Updated 4 years ago
- Spider templates for automatic crawlers.☆28Updated 3 weeks ago
- Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends☆56Updated last year
- Library for scraping websites or apis at any scale☆53Updated last year