Alternatives and similar repositories for scrapy-german-news:

Users that are interested in scrapy-german-news are comparing it to the libraries listed below

• TeamHG-Memex / extract-html-diff
  extract difference between two html pages
  ☆32Updated 6 years ago
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆41Updated 5 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 2 years ago
• xtannier / WebAnnotator
  WebAnnotator is a tool for annotating Web pages. WebAnnotator is implemented as a Firefox extension (https://addons.mozilla.org/en-US/fi…
  ☆48Updated 3 years ago
• scrapinghub / webpager
  Paginating the web
  ☆37Updated 11 years ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 2 years ago
• psolbach / metadoc
  Aviation grade news article metadata extraction
  ☆36Updated last year
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 6 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• GregBowyer / cld2-cffi
  Python bindings to the Compact Language Detector
  ☆33Updated 4 years ago
• ClimbsRocks / empythy
  Automated NLP sentiment predictions- batteries included, or use your own data
  ☆18Updated 7 years ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆80Updated 2 years ago
• fujimotos / TinyFastSS
  An index data structure for approximate string search.
  ☆23Updated 5 years ago
• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆56Updated last year
• ajschumacher / mergic
  workflow support for reproducible deduplication and merging
  ☆16Updated last year
• scrapinghub / shublang
  Pluggable DSL that uses pipes to perform a series of linear transformations to extract data
  ☆15Updated 7 months ago
• datalib / StatsCounter
  Python's missing statistical Swiss Army knife
  ☆15Updated 9 years ago
• trec-kba / streamcorpus
  common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text
  ☆35Updated 8 years ago
• dssg / pgdedupe
  A simple command line interface to the datamade/dedupe library.
  ☆42Updated 2 years ago
• vu3jej / scrapy-corenlp
  ☆59Updated 3 years ago
• rmax / scrapy-boilerplate
  Small set of utilities to simplify writing Scrapy spiders.
  ☆49Updated 9 years ago
• pudo-attic / scrapekit
  Python library with common functionality for writing web scrapers
  ☆102Updated 9 years ago
• wroberts / fsed
  Aho-Corasick string replacement utility
  ☆24Updated 5 years ago
• iproduct-database / vpm-filter-spark
  Virtual patent marking crawler at iproduct.epfl.ch
  ☆14Updated 7 years ago
• ChrisRoark / beagle_scraper
  Scraper for categories and lists on ecommerce and other listing websites
  ☆42Updated 4 years ago
• gpoulter / pydedupe
  (Archived) A Python library for record linkage and deduplication.
  ☆19Updated 11 months ago
• dmiro / bagofwords
  The main goal this Python module is to provide functions to apply Text Classification.
  ☆10Updated 8 years ago
• commonsense / metanl
  Some convenient natural language tools that build on NLTK.
  ☆85Updated 10 years ago
• abhinavgupta / Extract-News-Summary
  Pure python script that takes user query and summarizes news related to it.
  ☆25Updated 2 years ago
• word-fish / wordfish-python
  extract relationships from standardized terms from corpus of interest with deep learning
  ☆20Updated 5 years ago