Alternatives and similar repositories for starbelly

Users that are interested in starbelly are comparing it to the libraries listed below

• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 7 years ago
• scrapy / xtractmime
  https://mimesniff.spec.whatwg.org/ implementation for Python
  ☆13Updated last year
• bigger312 / Sanctions-Lists
  List of Sanctions and Most wanted
  ☆28Updated 7 years ago
• minimaxir / get-data-from-photos-from-instagram-tags
  Processes data from images which are tagged with the specified Instagram tag.
  ☆13Updated 11 years ago
• TeamHG-Memex / undercrawler
  A generic crawler
  ☆78Updated 7 years ago
• scrapinghub / shublang
  Pluggable DSL that uses pipes to perform a series of linear transformations to extract data
  ☆16Updated 10 months ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆79Updated 2 years ago
• alephdata / alephclient
  API client for Aleph, supports bulk entity and document upload.
  ☆28Updated 7 months ago
• fluquid / extract-social-media
  Extract social media links and account names from websites.
  ☆38Updated 4 years ago
• michenriksen / wikiranger
  Gather information on Wiki contributions from IP ranges
  ☆24Updated 7 years ago
• NC3-LU / MOSP
  A collaborative platform for creating, editing and sharing JSON objects.
  ☆73Updated 4 months ago
• guillermo-carrasco / social_ids
  Get user ids from social network handlers
  ☆12Updated 8 years ago
• rootVIII / proxy_web_crawler
  Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords
  ☆45Updated last year
• MITRECND / bulk
  A content inspecting SMTP proxy
  ☆17Updated 10 years ago
• kownet / osint-series
  Source codes related to the articles about OSINT. Using social media APIs and Python language.
  ☆22Updated 6 years ago
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated last year
• WebBreacher / foodndrink
  playing around with food and drink sites and OSINT
  ☆15Updated 6 years ago
• TeamHG-Memex / sitehound-frontend
  Site Hound (previously THH) is a Domain Discovery Tool
  ☆23Updated 3 years ago
• crawlbase / proxycrawl-python
  ProxyCrawl Python library for scraping and crawling
  ☆59Updated last year
• tb0hdan / idun
  DomainsProject.org HTTP worker
  ☆23Updated 2 years ago
• 9b / frisbee
  Collect email addresses by crawling search engine results.
  ☆29Updated 2 years ago
• duo-labs / tutorials
  ☆15Updated 6 years ago
• alephdata / ingest-file
  Ingestors extract the contents of mixed unstructured documents into structured (followthemoney) data.
  ☆63Updated 3 weeks ago
• HarryR / httphose
  Mass HTTP brute forcer to detect directories and interesting technologies
  ☆10Updated 8 years ago
• adulau / DomainClassifier
  DomainClassifier is a Python (2/3) library to extract and classify Internet domains/hostnames/IP addresses from raw unstructured text fil…
  ☆77Updated last year
• englehardt / cookies-that-give-you-away
  Code release for: Cookies that give you away: The surveillance implications of web tracking
  ☆53Updated 6 years ago
• adulau / napkin-text-analysis
  Napkin is a simple tool to produce statistical analysis of a text
  ☆12Updated last year
• 9b / lazyeye
  Chrome extension to extract data from websites surfed inside of chrome
  ☆18Updated 10 years ago
• Ghostofapacket / socialscrape-bot
  Bot for operating snscrape in #archivebot on efnet
  ☆10Updated 5 years ago
• TeamHG-Memex / extract-html-diff
  extract difference between two html pages
  ☆32Updated 7 years ago