Alternatives and similar repositories for open-gov-crawlers:

Users that are interested in open-gov-crawlers are comparing it to the libraries listed below

• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆42Updated 5 years ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆95Updated 3 months ago
• mscarey / AuthoritySpoke
  Reading legal authority for the last time
  ☆34Updated 8 months ago
• jkeefe / python-notes
  Where I keep my Python notes for starting projects
  ☆9Updated 2 years ago
• johnbumgarner / newshound
  This Python package can be used to systematically extract multiple data elements (e.g., title, keywords, text) from news sources around t…
  ☆32Updated last year
• simonw / scrape-open-data
  Scrape various open data directories to create an index of what's available out there
  ☆34Updated this week
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆56Updated 2 years ago
• Senzing / awesome
  Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.
  ☆54Updated last month
• public-law / datasets
  World legal info: scraped, organized, and permissively licensed under Creative Commons.
  ☆15Updated last year
• zytedata / python-zyte-api
  Python client for Zyte API
  ☆22Updated 3 months ago
• USPTO / TrademarkPublicData
  Utilties which support the proccessing of XML based USPTO trademark bulk download files
  ☆29Updated 4 years ago
• scrapy / itemadapter
  Common interface for data container classes
  ☆61Updated last month
• cldellow / datasette-scraper
  Add website scraping abilities to Datasette
  ☆62Updated last year
• mediacloud / feed_seeker
  Find rss, atom, xml, and rdf feeds on webpages
  ☆30Updated 3 months ago
• saulpw / readysetdata
  Scripts to make specific datasets cleaner and more convenient
  ☆40Updated 2 years ago
• zytedata / zyte-autoextract
  Python clients for Zyte AutoExtract API
  ☆40Updated 3 years ago
• TeamHG-Memex / html-text
  Extract text from HTML
  ☆133Updated 4 years ago
• hermit-crab / ScrapeMate
  Scraping assistant tool. Editing and maintaining CSS/XPath selectors across webpages.
  ☆101Updated 6 years ago
• scrapy-plugins / scrapy-zyte-api
  Zyte API integration for Scrapy
  ☆37Updated this week
• opensanctions / fingerprints
  Make it easier to compare and cross-reference the names of companies and people by applying strong normalisation.
  ☆147Updated last week
• scrapy / protego
  A pure-Python robots.txt parser with support for modern conventions.
  ☆57Updated this week
• eyeseast / feed-to-sqlite
  Save an RSS or ATOM feed to a SQLite database
  ☆47Updated 2 years ago
• scrapy-plugins / scrapy-headless
  ☆29Updated 3 years ago
• zytedata / zyte-spider-templates
  Spider templates for automatic crawlers.
  ☆25Updated this week
• freelawproject / citation-regexes
  A collection of regular expressions for matching citations to state, federal, and even international law
  ☆33Updated 3 years ago
• mediacloud / nyt-news-labeler
  Tag news stories based on models trained on the NYT corpus.
  ☆42Updated last year
• medialab / ural
  A helper library full of URL-related heuristics.
  ☆64Updated 3 months ago
• uscensusbureau / SABLE
  Scraping Assisted by Learning
  ☆35Updated this week
• jamesturk / spatula
  A modern Python library for writing maintainable web scrapers.
  ☆245Updated 6 months ago