Alternatives and similar repositories for WarcMiddleware

Users that are interested in WarcMiddleware are comparing it to the libraries listed below

• ikreymer / pywb-webrecorder
  Check out https://github.com/webrecorder/webrecorder for newer version matching https://webrecorder.io
  ☆38Updated 9 years ago
• ArchiveTeam / NewsGrabber
  Grabbing all news.
  ☆62Updated 5 years ago
• Alir3z4 / python-sanitize
  Bringing sanity to world of messed-up data
  ☆66Updated 10 years ago
• Miserlou / easy-expressions
  Easy Regular Expressions for Python
  ☆24Updated 2 years ago
• fullscale / pypes
  A component based data flow framework with a drag-n-drop Web 2.0 interface. Based on Stackless Python and inspired by Yahoo! Pipes.
  ☆150Updated 13 years ago
• toxinu / leselys
  I'm Leselys, your very elegant RSS reader.
  ☆226Updated 4 years ago
• liberit / scraptils
  scraper related helper functions
  ☆27Updated 11 years ago
• pudo-attic / scrapekit
  Python library with common functionality for writing web scrapers
  ☆102Updated 10 years ago
• redapple / parslepy
  Python implementation of the Parsley language for extracting structured data from web pages
  ☆92Updated 7 years ago
• rcarmo / bottle-fever
  A clean-room clone of the Fever RSS aggregator, focusing on the API
  ☆60Updated 3 years ago
• matiasb / demiurge
  PyQuery-based scraping micro-framework.
  ☆118Updated 3 years ago
• webrecorder / wsgiprox
  Python WSGI Middleware for adding HTTP/S proxy support to any WSGI Application
  ☆24Updated 4 years ago
• EugenePig / ebook-isbn
  An eBook tool to extract ISBN or Metadata form eBook and rename them by using ISBN database and Metadata
  ☆30Updated 10 years ago
• jabbalaci / Jabba-Webkit
  Jabba's headless webkit browser for scraping AJAX-powered webpages.
  ☆90Updated 10 years ago
• shish / devtools-py
  A Python client for Chrome's DevTools protocol / a headless chrome control library
  ☆15Updated 7 years ago
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated last year
• pyvideo / richard
  video indexing site
  ☆215Updated 9 years ago
• fusionbox / mouseware
  Secure random passwords in javascript
  ☆18Updated 5 years ago
• ArchiveTeam / VideoBot
  Specialised bot for periodical grabs and video/audio/etc. webpage scrapes.
  ☆11Updated 7 years ago
• scrapinghub / webpager
  Paginating the web
  ☆37Updated 11 years ago
• kaflesudip / grabfeed
  Python package to detect and return RSS / Atom feeds for a given website. The tool supports major blogging platform including Wordpress, …
  ☆21Updated 3 years ago
• 18F / scrapebox
  A simple, system independent infrastructure for performing web scraping. Utilizes Vagrant virtualbox interface and puppet provisioning to…
  ☆24Updated 11 years ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆79Updated 2 years ago
• TeamHG-Memex / extract-html-diff
  extract difference between two html pages
  ☆32Updated 7 years ago
• hatnote / cronfed
  Convert cron emails to RSS 2.0. It's the least you can do.
  ☆14Updated 10 years ago
• stephenmcd / gnotty
  IRC web client and bot framework
  ☆160Updated 10 years ago
• getpelican / heroku-buildpack-pelican
  This is a heroku buildpack for Pelican.
  ☆23Updated 3 years ago
• keybase / python-triplesec
  A Python port of the triplesec library.
  ☆82Updated last year
• SerenitySoftware / cahoots
  A Text Comprehension Engine in Python
  ☆15Updated 10 years ago
• webrecorder / har2warc
  Convert HTTP Archive (HAR) -> Web Archive (WARC) format
  ☆54Updated 6 years ago