Alternatives and similar repositories for scrapy-german-news

Users that are interested in scrapy-german-news are comparing it to the libraries listed below

• scrapinghub / webpager
  Paginating the web
  ☆37Updated 11 years ago
• xtannier / WebAnnotator
  WebAnnotator is a tool for annotating Web pages. WebAnnotator is implemented as a Firefox extension (https://addons.mozilla.org/en-US/fi…
  ☆48Updated 3 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 7 years ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 3 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• TeamHG-Memex / extract-html-diff
  extract difference between two html pages
  ☆32Updated 7 years ago
• ClimbsRocks / empythy
  Automated NLP sentiment predictions- batteries included, or use your own data
  ☆18Updated 7 years ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆79Updated 2 years ago
• vu3jej / scrapy-corenlp
  ☆59Updated 3 years ago
• kaflesudip / grabfeed
  Python package to detect and return RSS / Atom feeds for a given website. The tool supports major blogging platform including Wordpress, …
  ☆21Updated 3 years ago
• ChrisRoark / beagle_scraper
  Scraper for categories and lists on ecommerce and other listing websites
  ☆42Updated 4 years ago
• stefanw / scrapa
  Python 3 AsyncIO powered scraping framework with batteries included
  ☆20Updated 8 years ago
• TeamHG-Memex / soft404
  A classifier for detecting soft 404 pages
  ☆57Updated last year
• jaijuneja / PyTLDR
  A python module that automatically summarizes text documents and web pages
  ☆45Updated 2 years ago
• Parsely / serpextract
  Easy extraction of keywords and engines from search engine results pages (SERPs).
  ☆90Updated 3 years ago
• GregBowyer / cld2-cffi
  Python bindings to the Compact Language Detector
  ☆33Updated 5 years ago
• cocrawler / cocrawler
  CoCrawler is a versatile web crawler built using modern tools and concurrency.
  ☆191Updated 3 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 2 years ago
• ianozsvald / learning_text_transformer
  Search 'from' and 'to' strings to learn a text cleaning mapping
  ☆17Updated 9 years ago
• Webhose / article-date-extractor
  Automatically extracts and normalizes an online article or blog post publication date
  ☆117Updated last year
• datalib / StatsCounter
  Python's missing statistical Swiss Army knife
  ☆15Updated 9 years ago
• turian / pytextpreprocess
  Preprocess text for NLP (tokenizing, lowercasing, stemming, sentence splitting, etc.)
  ☆29Updated 14 years ago
• scalingexcellence / scrapy-solr
  Scrapy pipeline which allows you to store scrapy items in a solr server.
  ☆19Updated 9 years ago
• wroberts / fsed
  Aho-Corasick string replacement utility
  ☆24Updated 5 years ago
• rmax / scrapy-boilerplate
  Small set of utilities to simplify writing Scrapy spiders.
  ☆49Updated 9 years ago
• gpoulter / pydedupe
  (Archived) A Python library for record linkage and deduplication.
  ☆19Updated last year
• NAMD / pypln.backend
  Pipeline for distributed Natural Language Processing, made in Python
  ☆65Updated 8 years ago
• proycon / python-timbl
  python-timbl, originally developed by Sander Canisius, is a Python extension module wrapping the full TiMBL C++ programming interface. Wi…
  ☆18Updated last month
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆41Updated 5 years ago
• lethain / extraction
  A Python library for extracting titles, images, descriptions and canonical urls from HTML.
  ☆150Updated 5 years ago