Alternatives and similar repositories for awesome-crawler

Users that are interested in awesome-crawler are comparing it to the libraries listed below

• ArchiveTeam / WebArchiver
  Decentralized web archiving
  ☆20Updated 6 years ago
• citizenlab / web-censorship
  Collection of data about URL filtering in various countries
  ☆42Updated 8 years ago
• rustybird / corridor
  Tor traffic whitelisting gateway
  ☆72Updated 3 months ago
• TransparencyToolkit / Harvester
  Web crawling and document processing through a usable interface.
  ☆72Updated 8 years ago
• NitescuLucian / OSHardening
  OS Hardening scripts for multiple linux based operating systems. Keep in mind this is the minimum!
  ☆20Updated 8 years ago
• pirate / awesome-web-archiving
  An Awesome List for getting started with web archiving
  ☆19Updated 6 years ago
• glamrock / Stormy
  Easy creation of Tor Hidden Services
  ☆40Updated 10 years ago
• jotyGill / privacy-fighter
  Easy to install, privacy protection browser setup. A collection of best browser extensions and configurations to help you fight for your …
  ☆25Updated 5 years ago
• hubisan / searx-userstyle-dark-theme
  dark theme for searx for stylish & greasemonkey
  ☆11Updated 7 years ago
• ArchiveTeam / VideoBot
  Specialised bot for periodical grabs and video/audio/etc. webpage scrapes.
  ☆11Updated 7 years ago
• mattwright324 / hashID
  Web-app to identify the different types of hashes
  ☆21Updated last year
• k4m4 / onion-regex
  Regular expression for matching .onion Tor links (v2 & v3).
  ☆18Updated 2 years ago
• hovancik / BSDSec
  deadsimple BSD Security Advisories and Announcements
  ☆17Updated this week
• baddymaster / torrent-hound
  Search torrents from multiple websites via the CLI
  ☆33Updated 2 years ago
• pointhi / searx_stats
  A little website which is showing current stats about searx instances
  ☆19Updated 8 years ago
• Kicksecure / apparmor-profile-torbrowser
  AppArmor profile for The Tor Browser Bundle (TBB) - https://www.whonix.org/wiki/AppArmor - for better security (hardening).
  ☆20Updated 6 months ago
• nodiscc / distrib-dl
  [mirror] Download and verify Linux distribution installers/ISO images
  ☆19Updated 3 weeks ago
• danielmiessler / CertExpirationCheck
  Checks to see when the cert for a given domain expires.
  ☆19Updated 3 years ago
• marshyski / sshwatch
  Intrusion Prevention System (IPS) for Secure Shell (SSH)
  ☆51Updated 12 years ago
• IgnorantGuru / sandfox
  Runs Firefox and other apps in a filesystem sandbox
  ☆40Updated 11 years ago
• dbeley / archiveboxmatic
  ArchiveBoxMatic: configure ArchiveBox with the simplicity of a yaml file.
  ☆14Updated 4 years ago
• jedisct1 / massresolver
  Mass DNS resolution tool
  ☆37Updated 4 years ago
• eyedeekay / httptunnel
  Super simple standalone http proxy for i2p using SAM. (Also part of https://github.com/eyedeekay/sam-forwarder)
  ☆10Updated 3 years ago
• danielmiessler / Personal
  A repository for personal tracking.
  ☆15Updated 3 years ago
• WebBreacher / foodndrink
  playing around with food and drink sites and OSINT
  ☆16Updated 6 years ago
• dyne / domain-list
  A list of domains (including CDN hosts) belonging to ICT company silos, i.e. FB, GOOG, AMZN etc.
  ☆98Updated 11 months ago
• pedramamini / lazy-cd
  Path bookmarking for bash. I use this extensively throughout my day.
  ☆23Updated 5 years ago
• ip2k / WiFi-Abuse-Autokiller
  Finds abusive WiFi users using way too much traffic on public wifi and sends them a sack of hot deauth frames
  ☆32Updated 14 years ago
• endwall2 / endware
  The Endware Suite
  ☆52Updated last year
• danielmiessler / Self
  A tracking system for everything me, e.g.: beliefs, passions, must-haves, must-dos, favorite movies, favorite quotes, favorite aphorisms,…
  ☆21Updated 3 years ago