Alternatives and similar repositories for gogetcrawl

Users that are interested in gogetcrawl are comparing it to the libraries listed below

• hynky1999 / CmonCrawl
  Common crawl extractor
  ☆78Updated last year
• projectdiscovery / useragent
  Curated list of categorized User Agents
  ☆99Updated 2 weeks ago
• projectdiscovery / awesome-search-queries
  Community curated list of search queries for various products across multiple search engines.
  ☆197Updated last week
• bellingcat / whisperbox-transcribe
  Easy to deploy API for transcribing and translating audio / video using OpenAI's whisper model.
  ☆71Updated last year
• crissyfield / troll-a
  Drill into WARC web archives
  ☆140Updated 10 months ago
• tonywangcn / distributed-web-crawler
  The Architecture of a Web Crawler: Building a Google-Inspired Distributed Web Crawler
  ☆122Updated 8 months ago
• dwisiswant0 / stargather
  A fast GitHub stargazers information gathering tool
  ☆74Updated 3 years ago
• projectdiscovery / aix
  AIx is a cli tool to interact with Large Language Models (LLM) APIs.
  ☆303Updated 2 weeks ago
• chryzsh / GPTCommentDetector
  A UserScript to detect GPT generated comments on Hackernews.
  ☆14Updated 2 years ago
• dwisiswant0 / tlder
  TLDs finder — check domain name availability across all valid top-level domains.
  ☆108Updated 10 months ago
• s0rg / crawley
  The unix-way web crawler
  ☆310Updated last week
• dwisiswant0 / chatgptui
  ChatGPT 🤖 with Textual User Interface (TUI) mode written in Go.
  ☆92Updated 2 years ago
• opsdisk / yagooglesearch
  Yet another googlesearch - A Python library for executing intelligent, realistic-looking, and tunable Google searches.
  ☆283Updated last year
• Volifter / Belligcat-Hackathon
  ☆21Updated 11 months ago
• claromes / waybacktweets
  Archived tweets from the Wayback Machine
  ☆130Updated 3 months ago
• cemulus / crt
  A CLI tool to check Certificate Transparency logs of a domain name.
  ☆71Updated last month
• Josue87 / MetaFinder
  Search for documents in a domain through Search Engines (Google, Bing and Baidu). The objective is to extract metadata
  ☆219Updated last year
• claromes / telegramtrac
  Browser interface to Telegram's API with additional modules for generating datasets and network graphs
  ☆11Updated last year
• DedSecInside / gotor
  This program provides efficient web scraping services for Tor and non-Tor sites. The program has both a CLI and REST API.
  ☆167Updated 4 months ago
• blacknon / pydork
  Scraping and listing text and image searches on Google, Bing, DuckDuckGo, Baidu, Yahoo japan.
  ☆83Updated last year
• MischaU8 / spevktator
  An open source investigation tool to collect and analyse public VK community wall posts
  ☆36Updated 2 years ago
• XORbit01 / webpalm
  🕸️ Crawl in the web network
  ☆371Updated 5 months ago
• soxoj / bellingcat-hackathon-watchcats
  📊 Adana - 1-click analytical dashboard for OSINT researchers
  ☆40Updated last year
• tb0hdan / idun
  DomainsProject.org HTTP worker
  ☆23Updated 2 years ago
• bellingcat / sugartrail
  Visualise networks of companies, officers and addresses connected through UK Companies House
  ☆65Updated 10 months ago
• davemolk / goGetJS
  a tool for extracting, searching, and saving JavaScript files (with optional headless browser)
  ☆41Updated 2 years ago
• tanaikech / goris
  This is a CLI tool to search for images with Google Reverse Image Search (goris).
  ☆120Updated 2 months ago
• bellingcat / twitter-geocode-searches
  Analysis for "Geofenced Searches on Twitter: A Case Study Detailing South Asia’s Covid Crisis", published on May 19, 2021.
  ☆26Updated last year
• alpkeskin / rota
  A high-performance proxy rotation engine with automated IP management and real-time health monitoring
  ☆116Updated 4 months ago
• Lissy93 / wapalyzer
  🌐 Identify the technologies powering any website. This is a fork of the now deleted Wappalyzer project by @AliasIO and community.
  ☆286Updated last year