Alternatives and similar repositories for scrapy-german-news:

Users that are interested in scrapy-german-news are comparing it to the libraries listed below

• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 6 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• TeamHG-Memex / extract-html-diff
  extract difference between two html pages
  ☆32Updated 6 years ago
• scrapinghub / webpager
  Paginating the web
  ☆37Updated 10 years ago
• scrapy-plugins / scrapy-streaming
  ☆18Updated 8 years ago
• trec-kba / streamcorpus
  common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text
  ☆34Updated 8 years ago
• commonsearch / gumbocy
  Python binding for gumbo-parser using Cython
  ☆14Updated 8 years ago
• gpoulter / pydedupe
  (Archived) A Python library for record linkage and deduplication.
  ☆19Updated 10 months ago
• xtannier / WebAnnotator
  WebAnnotator is a tool for annotating Web pages. WebAnnotator is implemented as a Firefox extension (https://addons.mozilla.org/en-US/fi…
  ☆48Updated 3 years ago
• larsmans / weighwords
  Python library for creating word clouds from text
  ☆51Updated 5 years ago
• lethain / extraction
  A Python library for extracting titles, images, descriptions and canonical urls from HTML.
  ☆147Updated 4 years ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 2 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 2 years ago
• scrapinghub / autopager
  Detect and classify pagination links
  ☆15Updated 4 years ago
• weblyzard / ewrt
  extensible Web Retrieval Toolkit
  ☆17Updated 2 years ago
• codelucas / newspaper-demo
  Demo of the Newspaper article extraction library.
  ☆29Updated 10 years ago
• turian / pytextpreprocess
  Preprocess text for NLP (tokenizing, lowercasing, stemming, sentence splitting, etc.)
  ☆29Updated 13 years ago
• TeamHG-Memex / sitehound-frontend
  Site Hound (previously THH) is a Domain Discovery Tool
  ☆23Updated 3 years ago
• rodricios / crawl-to-the-future
  An attempt at creating a silver/gold standard dataset for backtesting yesterday & today's content-extractors
  ☆34Updated 9 years ago
• wroberts / fsed
  Aho-Corasick string replacement utility
  ☆24Updated 5 years ago
• nicodjimenez / bus_catchers
  Python scripts for scraping bus ticket data from the websites of BoltBus, Greyhound, Megabus, GoBus, Amtrak, Peterpan, and EasternTravel.
  ☆39Updated 4 years ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆80Updated 2 years ago
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆42Updated 5 years ago
• Parsely / schemato
  Modularly extensible semantic metadata validator
  ☆83Updated 9 years ago
• word-fish / wordfish-python
  extract relationships from standardized terms from corpus of interest with deep learning
  ☆20Updated 5 years ago
• ChrisRoark / beagle_scraper
  Scraper for categories and lists on ecommerce and other listing websites
  ☆42Updated 4 years ago
• CamDavidsonPilon / StartupFiles
  My IPython startup files.
  ☆109Updated 9 years ago
• datalib / StatsCounter
  Python's missing statistical Swiss Army knife
  ☆15Updated 9 years ago
• TeamHG-Memex / autologin-middleware
  Scrapy middleware for the autologin
  ☆37Updated 6 years ago
• dssg / pgdedupe
  A simple command line interface to the datamade/dedupe library.
  ☆42Updated 2 years ago