arthurk / scrapy-german-news

Related projects ⓘ

Alternatives and complementary repositories for scrapy-german-news

• GregBowyer / cld2-cffi
  Python bindings to the Compact Language Detector
  ☆33Updated 4 years ago
• scrapinghub / webpager
  Paginating the web
  ☆37Updated 10 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 7 years ago
• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆56Updated 9 months ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 2 years ago
• ChrisRoark / beagle_scraper
  Scraper for categories and lists on ecommerce and other listing websites
  ☆43Updated 4 years ago
• codelucas / newspaper-demo
  Demo of the Newspaper article extraction library.
  ☆29Updated 10 years ago
• ClimbsRocks / empythy
  Automated NLP sentiment predictions- batteries included, or use your own data
  ☆18Updated 6 years ago
• fbkarsdorp / pdfbrowser
  Simple Flask webservice to search through your PDF collection using Whoosh
  ☆11Updated 10 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 6 years ago
• chuanconggao / html2json
  Lightweight library that converts a HTML webpage to JSON data using a template defined in JSON.
  ☆21Updated 4 years ago
• stefanw / scrapa
  Python 3 AsyncIO powered scraping framework with batteries included
  ☆20Updated 8 years ago
• TeamHG-Memex / extract-html-diff
  extract difference between two html pages
  ☆32Updated 6 years ago
• gpoulter / pydedupe
  (Archived) A Python library for record linkage and deduplication.
  ☆19Updated 8 months ago
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆42Updated 5 years ago
• dfm / feedfinder2
  A Python library for finding feed links on websites.
  ☆50Updated 2 years ago
• IndicoDataSolutions / plotlines
  Exploring the shapes of stories using indico sentiment analysis APIs
  ☆28Updated 9 years ago
• margaret / python-datamuse
  (Deprecated - please use https://github.com/gmarmstrong/python-datamuse) Python wrapper for the Datamuse API
  ☆15Updated 6 years ago
• pirate / spellchecker
  A spell-checker extending Peter Norvig's with multi-typo correction, hamming distance weighting, and more.
  ☆97Updated 4 years ago
• spitis / PyIndex
  ☆12Updated 7 years ago
• rmax / scrapy-boilerplate
  Small set of utilities to simplify writing Scrapy spiders.
  ☆49Updated 9 years ago
• burrsettles / readability
  Text readability metrics in Python.
  ☆12Updated 11 years ago
• trec-kba / streamcorpus
  common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text
  ☆34Updated 8 years ago
• pudo-attic / scrapekit
  Python library with common functionality for writing web scrapers
  ☆102Updated 9 years ago
• kaflesudip / grabfeed
  Python package to detect and return RSS / Atom feeds for a given website. The tool supports major blogging platform including Wordpress, …
  ☆21Updated 3 years ago
• xtannier / WebAnnotator
  WebAnnotator is a tool for annotating Web pages. WebAnnotator is implemented as a Firefox extension (https://addons.mozilla.org/en-US/fi…
  ☆48Updated 2 years ago
• fujimotos / TinyFastSS
  An index data structure for approximate string search.
  ☆23Updated 5 years ago
• scrapinghub / shublang
  Pluggable DSL that uses pipes to perform a series of linear transformations to extract data
  ☆15Updated 4 months ago