Girbons / mercury-parserpy

Related projects ⓘ

Alternatives and complementary repositories for mercury-parserpy

• scrapy / itemadapter
  Common interface for data container classes
  ☆62Updated this week
• scrapy-plugins / scrapy-magicfields
  Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.
  ☆56Updated 2 years ago
• scrapy / itemloaders
  Library to populate items using XPath and CSS with a convenient API
  ☆45Updated last month
• NicolasLM / atoma
  Atom, RSS and JSON feed parser for Python 3
  ☆116Updated 2 years ago
• zyocum / reader
  Extract clean(er), readable text from web pages via Mercury Web Parser.
  ☆117Updated 4 months ago
• TeamHG-Memex / html-text
  Extract text from HTML
  ☆132Updated 4 years ago
• povilasb / scrapy-html-storage
  Scrapy downloader middleware that stores response HTMLs to disk.
  ☆18Updated 6 months ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆79Updated 2 years ago
• rsarai / hq
  This is the HeadQuarters of my digital info. HPI library got me inspired and I'm trying to play with the idea on a smaller scale for myse…
  ☆19Updated last year
• ThomasAitken / Scrapy-Testmaster
  The most advanced debugging and testing tool for Scrapy
  ☆16Updated last year
• niksite / url-normalize
  URL normalization for Python
  ☆94Updated 2 years ago
• woxcab / scrapy_rss
  Tools to easy generate RSS feed that contains each scraped item using Scrapy framework.
  ☆31Updated this week
• INNOVINATI / microwler
  A micro-framework for asynchronous deep crawls and web scraping with Python
  ☆13Updated last year
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆42Updated 5 years ago
• dfm / feedfinder2
  A Python library for finding feed links on websites.
  ☆50Updated 2 years ago
• further-reading / scrapy-gui
  A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.
  ☆106Updated 6 months ago
• hamano / flask-mail-sendgrid
  Flask extension for sendgrid. It has same interface with Flask-Mail.
  ☆16Updated last year
• zytedata / zyte-spider-templates
  Spider templates for automatic crawlers.
  ☆24Updated this week
• aurelg / linkbak
  linkbak is a web page archiver : it reads a list of links and dumps the corresponding pages in HTML and PDF.
  ☆14Updated last year
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆55Updated 2 years ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆95Updated last month
• purarue / autotui
  quickly create UIs to interactively prompt, validate, and persist python objects to disk (JSON/YAML) and back using type hints
  ☆13Updated last month
• eyeseast / feed-to-sqlite
  Save an RSS or ATOM feed to a SQLite database
  ☆47Updated 2 years ago
• fazalmajid / temboz
  The Temboz RSS/Atom feed reader
  ☆82Updated last year
• Granitosaurus / parsel-cli
  cli for evaluating css and xpath selectors
  ☆26Updated last year
• rpasta42 / phone-scraper
  Python library for finding phone numbers in random user input text.
  ☆9Updated 7 years ago
• scrapy / protego
  A pure-Python robots.txt parser with support for modern conventions.
  ☆55Updated last week
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 2 years ago
• seomoz / url-py
  URL Transformation, Sanitization
  ☆103Updated 10 months ago