Alternatives and similar repositories for WarcMiddleware:

Users that are interested in WarcMiddleware are comparing it to the libraries listed below

• alard / warc-proxy
  Serving content from a WARC
  ☆61Updated 12 years ago
• rcarmo / bottle-fever
  A clean-room clone of the Fever RSS aggregator, focusing on the API
  ☆61Updated 2 years ago
• Alir3z4 / python-sanitize
  Bringing sanity to world of messed-up data
  ☆65Updated 10 years ago
• jabbalaci / Jabba-Webkit
  Jabba's headless webkit browser for scraping AJAX-powered webpages.
  ☆91Updated 10 years ago
• redapple / parslepy
  Python implementation of the Parsley language for extracting structured data from web pages
  ☆92Updated 7 years ago
• pudo-attic / scrapekit
  Python library with common functionality for writing web scrapers
  ☆102Updated 9 years ago
• kpurdon / waybacklapse
  A WayBack Machine Time-Lapse Generator
  ☆29Updated 6 years ago
• PromyLOPh / crocoite
  Web archiving using Google Chrome
  ☆44Updated 5 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 6 years ago
• narimiran / scopy
  Python script for searching through your digital books and cataloguing them in an easy-to-share list of files.
  ☆31Updated 5 years ago
• 18F / scrapebox
  A simple, system independent infrastructure for performing web scraping. Utilizes Vagrant virtualbox interface and puppet provisioning to…
  ☆24Updated 10 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated 9 years ago
• Parsely / serpextract
  Easy extraction of keywords and engines from search engine results pages (SERPs).
  ☆90Updated 3 years ago
• webrecorder / wsgiprox
  Python WSGI Middleware for adding HTTP/S proxy support to any WSGI Application
  ☆23Updated 4 years ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆79Updated 2 years ago
• iandennismiller / offline-pages
  Save a bunch of web pages as a self-contained, compressed archive file for offline storage and sharing.
  ☆35Updated 12 years ago
• pyvideo / richard
  video indexing site
  ☆217Updated 9 years ago
• shish / devtools-py
  A Python client for Chrome's DevTools protocol / a headless chrome control library
  ☆15Updated 6 years ago
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated 7 months ago
• nicodjimenez / bus_catchers
  Python scripts for scraping bus ticket data from the websites of BoltBus, Greyhound, Megabus, GoBus, Amtrak, Peterpan, and EasternTravel.
  ☆39Updated 4 years ago
• seomoz / url-py
  URL Transformation, Sanitization
  ☆103Updated last year
• Lukasa / httpcache
  Simple HTTP cache for Python Requests
  ☆98Updated 8 years ago
• localwiki / localwiki-backend-server
  Primary LocalWiki backend server environment
  ☆48Updated 7 years ago
• ArchiveTeam / VideoBot
  Specialised bot for periodical grabs and video/audio/etc. webpage scrapes.
  ☆11Updated 7 years ago
• beeware / slick
  A native web-based client for Slack.
  ☆23Updated 7 years ago
• thewhitetulip / pyfox
  A small python script for easy access to firefox bookmarks and browsing history
  ☆22Updated 4 years ago