Alternatives and similar repositories for pa11ycrawler:

Users that are interested in pa11ycrawler are comparing it to the libraries listed below

• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• NAMD / pypln.backend
  Pipeline for distributed Natural Language Processing, made in Python
  ☆64Updated 8 years ago
• rmax / scrapy-boilerplate
  Small set of utilities to simplify writing Scrapy spiders.
  ☆49Updated 9 years ago
• TeamHG-Memex / extract-html-diff
  extract difference between two html pages
  ☆32Updated 6 years ago
• xtannier / WebAnnotator
  WebAnnotator is a tool for annotating Web pages. WebAnnotator is implemented as a Firefox extension (https://addons.mozilla.org/en-US/fi…
  ☆48Updated 3 years ago
• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆56Updated last year
• minimaxir / legaladvice-gpt2
  Dump of generated texts from GPT-2 trained on /r/legaladvice subreddit titles
  ☆23Updated 6 years ago
• ncouture / python-search-engine
  Search engine base (crawler, indexer and parser) using Python, Celery, RabbitMQ, CouchDB and Whoosh.
  ☆11Updated last year
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 2 years ago
• Prooffreader / word_list_tools
  Python and pandas tools to perform various analyses on different types of word lists
  ☆16Updated 10 years ago
• Parsely / python-nlp-slides
  Slides to learn a little natural language processing (NLP) with Python. Written in reST with S5/Docutils.
  ☆28Updated 12 years ago
• AnthonySigogne / keyword-mining
  API - extract a list of keywords from a text.
  ☆18Updated 7 years ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 3 years ago
• hatnote / weeklypedia-history
  All the reports and data powering http://weekly.hatnote.com
  ☆13Updated this week
• martinweigert / minimal_flight_search
  A minimalist flight search engine written in Python
  ☆12Updated 7 years ago
• scrapinghub / scrapy-mosquitera
  Restrict crawl and scraping scope using matchers.
  ☆25Updated 8 years ago
• commonsearch / gumbocy
  Python binding for gumbo-parser using Cython
  ☆14Updated 8 years ago
• scrapinghub / scrapinghub-entrypoint-scrapy
  Scrapy entrypoint for Scrapinghub job runner
  ☆26Updated last month
• trec-kba / streamcorpus
  common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text
  ☆35Updated 8 years ago
• rmax / databrewer
  The missing datasets manager. Like hombrew but for datasets. CLI-tool for search and discover datasets!
  ☆39Updated 7 years ago
• ryansb / bookmarkd
  Markdown -> IPython conversion tool
  ☆15Updated 10 years ago
• scrapinghub / scaws
  Extensions for using Scrapy on Amazon AWS
  ☆32Updated 12 years ago
• ClimbsRocks / empythy
  Automated NLP sentiment predictions- batteries included, or use your own data
  ☆18Updated 7 years ago
• TeamHG-Memex / sitehound-frontend
  Site Hound (previously THH) is a Domain Discovery Tool
  ☆23Updated 3 years ago
• jxltom / scrapymon
  Simple Web UI for Scrapy spider management via Scrapyd
  ☆51Updated 6 years ago
• pudo-attic / scrapekit
  Python library with common functionality for writing web scrapers
  ☆102Updated 9 years ago
• scrapinghub / webpager
  Paginating the web
  ☆37Updated 11 years ago
• hernamesbarbara / table2csv
  Extract data from an HTML table and store results to a csv file.
  ☆38Updated 9 years ago
• stummjr / books_crawler
  A Scrapy crawler for http://books.toscrape.com
  ☆27Updated 7 years ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆80Updated 2 years ago