Alternatives and similar repositories for open-gov-crawlers

Users that are interested in open-gov-crawlers are comparing it to the libraries listed below

• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆41Updated 5 years ago
• cldellow / datasette-scraper
  Add website scraping abilities to Datasette
  ☆61Updated 2 years ago
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆56Updated 3 years ago
• public-law / datasets
  World legal info: scraped, organized, and permissively licensed under Creative Commons.
  ☆17Updated last month
• simonw / scrape-open-data
  Scrape various open data directories to create an index of what's available out there
  ☆36Updated 3 months ago
• freelawproject / disclosure-extractor
  A financial disclosure data extraction tool.
  ☆16Updated last year
• jamesturk / spatula
  A modern Python library for writing maintainable web scrapers.
  ☆250Updated 10 months ago
• scrapinghub / scrapinghub-stack-scrapy
  Software stack with latest Scrapy and updated deps
  ☆64Updated 3 months ago
• appeler / clean-names
  Deduplicate and parse list of `dirty names'
  ☆23Updated 4 years ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆99Updated 3 months ago
• Senzing / awesome
  Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.
  ☆57Updated last month
• medialab / ural
  A helper library full of URL-related heuristics.
  ☆69Updated last month
• scrapy-plugins / scrapy-headless
  ☆29Updated 4 years ago
• jkeefe / python-notes
  Where I keep my Python notes for starting projects
  ☆9Updated 2 years ago
• ScrapingBee / scrapy-scrapingbee
  JavaScript support and proxy rotation for Scrapy with ScrapingBee.
  ☆38Updated last year
• freelawproject / courts-db
  A database of courts, tests and other experiments
  ☆79Updated this week
• mscarey / AuthoritySpoke
  Reading legal authority for the last time
  ☆37Updated 2 months ago
• TeamHG-Memex / html-text
  Extract text from HTML
  ☆135Updated 4 years ago
• robrem / opensecrets-crpapi
  Python client for the Center for Responsive Politics API at OpenSecrets.org.
  ☆43Updated 5 years ago
• Police-Data-Accessibility-Project / scrapers
  Code relating to scraping public police data.
  ☆165Updated 3 months ago
• eyeseast / feed-to-sqlite
  Save an RSS or ATOM feed to a SQLite database
  ☆51Updated 2 years ago
• freelawproject / judge-pics
  A community-curated collection of judge profile pics that can be integrated anywhere
  ☆26Updated this week
• mediacloud / feed_seeker
  Find rss, atom, xml, and rdf feeds on webpages
  ☆30Updated 7 months ago
• zytedata / zyte-autoextract
  Python clients for Zyte AutoExtract API
  ☆40Updated 3 years ago
• zytedata / zyte-spider-templates
  Spider templates for automatic crawlers.
  ☆29Updated 3 weeks ago
• harvard-lil / cap-examples
  Examples for getting started using https://case.law
  ☆65Updated 2 years ago
• scrapy / itemadapter
  Common interface for data container classes
  ☆67Updated last month
• openvenues / lieu
  Dedupe/batch geocode addresses and venues around the world with libpostal
  ☆83Updated 3 years ago
• opensanctions / yente
  API for OpenSanctions with support for entity search and bulk matching of data collections. Supports Reconciliation API spec.
  ☆82Updated this week
• scrapinghub / scrapy-poet
  Page Object pattern for Scrapy
  ☆121Updated this week