Alternatives and similar repositories for open-gov-crawlers

Users that are interested in open-gov-crawlers are comparing it to the libraries listed below

• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆41Updated 5 years ago
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆56Updated 3 years ago
• freelawproject / reporters-db
  A database of court reporters, tests and other experiments
  ☆110Updated last week
• scrapinghub / scrapinghub-stack-scrapy
  Software stack with latest Scrapy and updated deps
  ☆63Updated this week
• opensanctions / fingerprints
  Now included in rigour
  ☆151Updated 2 months ago
• mediacloud / feed_seeker
  Find rss, atom, xml, and rdf feeds on webpages
  ☆30Updated 9 months ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆102Updated 2 weeks ago
• robrem / opensecrets-crpapi
  Python client for the Center for Responsive Politics API at OpenSecrets.org.
  ☆43Updated 5 years ago
• medialab / ural
  A helper library full of URL-related heuristics.
  ☆70Updated last month
• simonw / scrape-open-data
  Scrape various open data directories to create an index of what's available out there
  ☆37Updated 5 months ago
• freelawproject / disclosure-extractor
  A financial disclosure data extraction tool.
  ☆16Updated last year
• mscarey / AuthoritySpoke
  Reading legal authority for the last time
  ☆40Updated 4 months ago
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆123Updated 2 weeks ago
• mediacloud / nyt-news-labeler
  Tag news stories based on models trained on the NYT corpus.
  ☆42Updated 2 years ago
• johnbumgarner / newshound
  This Python package can be used to systematically extract multiple data elements (e.g., title, keywords, text) from news sources around t…
  ☆33Updated 2 years ago
• opensanctions / yente
  API for OpenSanctions with support for entity search and bulk matching of data collections. Supports Reconciliation API spec.
  ☆86Updated last week
• jkeefe / python-notes
  Where I keep my Python notes for starting projects
  ☆9Updated 2 years ago
• zytedata / zyte-autoextract
  Python clients for Zyte AutoExtract API
  ☆40Updated 3 years ago
• mikepqr / real-estate-scrape-eg
  A repository demonstrating the use of real-estate-scrape to store the estimated value of a property on Redfin and Zillow every night usin…
  ☆34Updated this week
• unitedstates / BillMap
  Utilities and applications for the FlatGov project by Demand Progress
  ☆16Updated 2 years ago
• eyeseast / feed-to-sqlite
  Save an RSS or ATOM feed to a SQLite database
  ☆52Updated 2 years ago
• vaneseltine / nominally
  A maximum-strength name parser for record linkage.
  ☆37Updated last month
• sangaline / scrapy-wayback-machine
  A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
  ☆116Updated last year
• opensanctions / storyweb
  Extract networks of entities from journalistic reporting
  ☆48Updated 2 years ago
• alephdata / alephclient
  API client for Aleph, supports bulk entity and document upload.
  ☆28Updated 9 months ago
• uscensusbureau / SABLE
  Scraping Assisted by Learning
  ☆35Updated 2 months ago
• jamesturk / spatula
  A modern Python library for writing maintainable web scrapers.
  ☆249Updated last month
• jsvine / buzzfeed-news-trending-strip
  Dataset: BuzzFeed News “Trending” Strip, 2018–2023
  ☆19Updated 2 years ago
• datamade / how-to
  📚 Doing all sorts of things, the DataMade way
  ☆98Updated 4 months ago
• cldellow / datasette-scraper
  Add website scraping abilities to Datasette
  ☆64Updated 2 years ago