Alternatives and similar repositories for WarcMiddleware:

Users that are interested in WarcMiddleware are comparing it to the libraries listed below

• alard / warc-proxy
  Serving content from a WARC
  ☆61Updated 12 years ago
• ikreymer / pywb-webrecorder
  Check out https://github.com/webrecorder/webrecorder for newer version matching https://webrecorder.io
  ☆38Updated 9 years ago
• ArchiveTeam / NewsGrabber
  Grabbing all news.
  ☆62Updated 5 years ago
• Alir3z4 / python-sanitize
  Bringing sanity to world of messed-up data
  ☆66Updated 10 years ago
• rcarmo / bottle-fever
  A clean-room clone of the Fever RSS aggregator, focusing on the API
  ☆61Updated 3 years ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆80Updated 2 years ago
• localwiki / localwiki-backend-server
  Primary LocalWiki backend server environment
  ☆48Updated 7 years ago
• pudo-attic / scrapekit
  Python library with common functionality for writing web scrapers
  ☆102Updated 9 years ago
• toxinu / leselys
  I'm Leselys, your very elegant RSS reader.
  ☆226Updated 4 years ago
• jabbalaci / Jabba-Webkit
  Jabba's headless webkit browser for scraping AJAX-powered webpages.
  ☆91Updated 10 years ago
• fusionbox / mouseware
  Secure random passwords in javascript
  ☆18Updated 5 years ago
• EugenePig / ebook-isbn
  An eBook tool to extract ISBN or Metadata form eBook and rename them by using ISBN database and Metadata
  ☆30Updated 9 years ago
• PromyLOPh / crocoite
  Web archiving using Google Chrome
  ☆44Updated 5 years ago
• shish / devtools-py
  A Python client for Chrome's DevTools protocol / a headless chrome control library
  ☆15Updated 6 years ago
• matiasb / demiurge
  PyQuery-based scraping micro-framework.
  ☆116Updated 3 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 6 years ago
• 18F / scrapebox
  A simple, system independent infrastructure for performing web scraping. Utilizes Vagrant virtualbox interface and puppet provisioning to…
  ☆24Updated 10 years ago
• scrapinghub / portia2code
  ☆50Updated 3 years ago
• redapple / parslepy
  Python implementation of the Parsley language for extracting structured data from web pages
  ☆92Updated 7 years ago
• internetarchive / umbra
  A queue-controlled browser automation tool for improving web crawl quality
  ☆61Updated last month
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated 11 months ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 3 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• scrapinghub / webpager
  Paginating the web
  ☆37Updated 11 years ago
• nicodjimenez / bus_catchers
  Python scripts for scraping bus ticket data from the websites of BoltBus, Greyhound, Megabus, GoBus, Amtrak, Peterpan, and EasternTravel.
  ☆39Updated 4 years ago
• scrapy-plugins / scrapy-splitvariants
  Scrapy spider middleware to split an item into multiple items using a multi-valued key
  ☆20Updated 8 years ago
• gsko / mdht
  A library with protocols needed to run a Mainline DHT node (written with Twisted)
  ☆68Updated 11 years ago
• pyvideo / richard
  video indexing site
  ☆217Updated 9 years ago
• Miserlou / easy-expressions
  Easy Regular Expressions for Python
  ☆24Updated 2 years ago
• operasoftware / django-feeds
  Django feeds provides an extensive database model for RSS feeds and a fault tolerant parser.
  ☆31Updated 12 years ago