Alternatives and similar repositories for open-gov-crawlers

Users that are interested in open-gov-crawlers are comparing it to the libraries listed below

• medialab / ural
  A helper library full of URL-related heuristics.
  ☆73Updated last month
• opensanctions / fingerprints
  Now included in rigour
  ☆152Updated last month
• mscarey / AuthoritySpoke
  Reading legal authority for the last time
  ☆40Updated 7 months ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆101Updated last week
• stav / wgrep
  Web grep: search all rendered resources used by a URI
  ☆89Updated last month
• jamesturk / spatula
  A modern Python library for writing maintainable web scrapers.
  ☆247Updated 4 months ago
• Senzing / awesome
  Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.
  ☆62Updated this week
• freelawproject / reporters-db
  A database of court reporters, tests and other experiments
  ☆117Updated last week
• zytedata / zyte-autoextract
  Python clients for Zyte AutoExtract API
  ☆40Updated 3 years ago
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆41Updated 6 years ago
• scrapinghub / scrapinghub-stack-scrapy
  Software stack with latest Scrapy and updated deps
  ☆65Updated 2 months ago
• ScrapingBee / scrapy-scrapingbee
  JavaScript support and proxy rotation for Scrapy with ScrapingBee.
  ☆38Updated last year
• opensanctions / yente
  API for OpenSanctions with support for entity search and bulk matching of data collections. Supports Reconciliation API spec.
  ☆108Updated last week
• nostalgia-dev / nostalgia
  Utilize your personal data like Google!
  ☆160Updated 2 years ago
• cldellow / datasette-scraper
  Add website scraping abilities to Datasette
  ☆64Updated 2 years ago
• eyeseast / feed-to-sqlite
  Save an RSS or ATOM feed to a SQLite database
  ☆57Updated last week
• zytedata / zyte-spider-templates
  Spider templates for automatic crawlers.
  ☆32Updated last month
• freelawproject / disclosure-extractor
  A financial disclosure data extraction tool.
  ☆18Updated 2 years ago
• uscensusbureau / SABLE
  Scraping Assisted by Learning
  ☆35Updated last month
• peopledatalabs / peopledatalabs-python
  A Python client for the People Data Labs API
  ☆35Updated last week
• opensanctions / countrynames
  Utility library to turn country names into ISO two-letter codes
  ☆71Updated 2 months ago
• simonw / scrape-hacker-news-by-domain
  Scrape HN to track links from specific domains
  ☆67Updated this week
• andrewtavis / wikirepo
  Python based Wikidata framework for easy dataframe extraction
  ☆45Updated last year
• harvard-lil / cap-examples
  Examples for getting started using https://case.law
  ☆69Updated 3 years ago
• simonw / scrape-open-data
  Scrape various open data directories to create an index of what's available out there
  ☆37Updated 8 months ago
• dogsheep / google-takeout-to-sqlite
  Save data from Google Takeout to a SQLite database
  ☆115Updated 2 years ago
• TeamHG-Memex / html-text
  Extract text from HTML
  ☆134Updated 5 years ago
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆56Updated 3 years ago
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆123Updated 2 weeks ago
• vaneseltine / nominally
  A maximum-strength name parser for record linkage.
  ☆38Updated last month