Alternatives and similar repositories for gogetcrawl

Users that are interested in gogetcrawl are comparing it to the libraries listed below

• hynky1999 / CmonCrawl
  Common crawl extractor
  ☆75Updated last year
• projectdiscovery / useragent
  Curated list of categorized User Agents
  ☆94Updated this week
• projectdiscovery / awesome-search-queries
  Community curated list of search queries for various products across multiple search engines.
  ☆185Updated this week
• crissyfield / troll-a
  Drill into WARC web archives
  ☆138Updated 7 months ago
• tb0hdan / idun
  DomainsProject.org HTTP worker
  ☆23Updated 2 years ago
• bellingcat / whisperbox-transcribe
  Easy to deploy API for transcribing and translating audio / video using OpenAI's whisper model.
  ☆68Updated last year
• soxoj / username-generation-guide
  A definitive guide to generating usernames for OSINT purposes
  ☆163Updated 11 months ago
• crissyfield / crux-dumps
  📝 This repository contains dumps of the monthly "Chrome UX Report" (CrUX) datasets.
  ☆43Updated 3 weeks ago
• bellingcat / reddit-post-scraping-tool
  Given a subreddit name and a keyword, this program returns all top (by default) posts that contain the specified keyword.
  ☆90Updated last year
• commoncrawl / cc-index-table
  Index Common Crawl archives in tabular format
  ☆120Updated 2 weeks ago
• chryzsh / GPTCommentDetector
  A UserScript to detect GPT generated comments on Hackernews.
  ☆14Updated 2 years ago
• markusmobius / go-trafilatura
  go-trafilatura is a Go port of the trafilatura Python library.
  ☆89Updated 2 weeks ago
• blacknon / pydork
  Scraping and listing text and image searches on Google, Bing, DuckDuckGo, Baidu, Yahoo japan.
  ☆82Updated last year
• MischaU8 / spevktator
  An open source investigation tool to collect and analyse public VK community wall posts
  ☆36Updated 2 years ago
• dwisiswant0 / tlder
  TLDs finder — check domain name availability across all valid top-level domains.
  ☆106Updated 7 months ago
• Volifter / Belligcat-Hackathon
  ☆21Updated 8 months ago
• sw33tLie / impressive-chatgpt
  A collection of impressive and useful results from OpenAI's chatgpt
  ☆74Updated 2 years ago
• s0rg / crawley
  The unix-way web crawler
  ☆297Updated last week
• krlabs / linkedin-dorks
  LinkedIn Search Tools & Google Dorks & X-Ray Search
  ☆61Updated 2 years ago
• mrdotparasyte / reX
  Reverse Engineered Twitter's API
  ☆75Updated last year
• cemulus / crt
  A CLI tool to check Certificate Transparency logs of a domain name.
  ☆70Updated last week
• opsdisk / yagooglesearch
  Yet another googlesearch - A Python library for executing intelligent, realistic-looking, and tunable Google searches.
  ☆277Updated last year
• Josue87 / MetaFinder
  Search for documents in a domain through Search Engines (Google, Bing and Baidu). The objective is to extract metadata
  ☆217Updated last year
• securibee / Awesome-Twitter-Lists
  A curated list of Awesome Twitter Lists
  ☆28Updated 2 years ago
• soxoj / async-search-scraper
  Search google, bing, yahoo, and other search engines with python
  ☆58Updated 3 years ago
• dwisiswant0 / ipfuscator
  A blazing-fast, thread-safe, straightforward and zero memory allocations tool to swiftly generate alternative IP(v4) address representati…
  ☆86Updated last year
• davemolk / searcher
  Run a base query (plus optional add-ons) through ask, bing, brave, duck duck go, yahoo, and yandex.
  ☆22Updated 2 years ago
• davemolk / goGetJS
  a tool for extracting, searching, and saving JavaScript files (with optional headless browser)
  ☆42Updated 2 years ago
• tonywangcn / distributed-web-crawler
  The Architecture of a Web Crawler: Building a Google-Inspired Distributed Web Crawler
  ☆115Updated 5 months ago
• Haax9 / WaybackPDF
  OSINT tool to download archived PDF files from archive.org for a given website.
  ☆48Updated 4 years ago