Alternatives and similar repositories for gogetcrawl

Users that are interested in gogetcrawl are comparing it to the libraries listed below

• hynky1999 / CmonCrawl
  Common crawl extractor
  ☆84Updated last year
• bellingcat / whisperbox-transcribe
  Easy to deploy API for transcribing and translating audio / video using OpenAI's whisper model.
  ☆68Updated last year
• projectdiscovery / useragent
  Curated list of categorized User Agents
  ☆110Updated 2 weeks ago
• bellingcat / sugartrail
  Visualise networks of companies, officers and addresses connected through UK Companies House
  ☆71Updated 3 months ago
• Volifter / Belligcat-Hackathon
  ☆20Updated last month
• chryzsh / GPTCommentDetector
  A UserScript to detect GPT generated comments on Hackernews.
  ☆13Updated 3 years ago
• tonywangcn / distributed-web-crawler
  The Architecture of a Web Crawler: Building a Google-Inspired Distributed Web Crawler
  ☆125Updated last year
• crissyfield / troll-a
  Drill into WARC web archives
  ☆141Updated last year
• tb0hdan / freya
  DomainsProject.org DNS worker
  ☆26Updated last year
• sshh12 / llm_osint
  LLM OSINT is a proof-of-concept method of using LLMs to gather information from the internet and then perform a task with this informatio…
  ☆257Updated last year
• opsdisk / yagooglesearch
  Yet another googlesearch - A Python library for executing intelligent, realistic-looking, and tunable Google searches.
  ☆288Updated last year
• lawzava / scrape
  CLI utility to scrape emails from websites
  ☆171Updated 2 months ago
• dwisiswant0 / tlder
  TLDs finder — check domain name availability across all valid top-level domains.
  ☆108Updated last year
• claromes / waybacktweets
  Archived tweets from the Wayback Machine
  ☆166Updated 8 months ago
• bellingcat / reddit-post-scraping-tool
  Given a subreddit name and a keyword, this program returns all top (by default) posts that contain the specified keyword.
  ☆94Updated 2 years ago
• cvcio / rtaa-72
  RTAA-72, is CVCIO's real-time intelligence dashboard for Twitter
  ☆20Updated 3 years ago
• Josue87 / MetaFinder
  Search for documents in a domain through Search Engines (Google, Bing and Baidu). The objective is to extract metadata
  ☆218Updated 2 years ago
• davemolk / searcher
  Run a base query (plus optional add-ons) through ask, bing, brave, duck duck go, yahoo, and yandex.
  ☆25Updated 2 years ago
• akamhy / waybackpy
  Wayback Machine API interface & a command-line tool
  ☆561Updated last year
• bellingcat / name-variant-search
  A tool for searching common variations of a human name
  ☆49Updated last month
• dwisiswant0 / stargather
  A fast GitHub stargazers information gathering tool
  ☆72Updated 3 years ago
• tanaikech / goris
  This is a CLI tool to search for images with Google Reverse Image Search (goris).
  ☆122Updated 7 months ago
• sw33tLie / impressive-chatgpt
  A collection of impressive and useful results from OpenAI's chatgpt
  ☆76Updated 3 years ago
• Beadyhx / going_places
  The script uses an Google maps API to download photos of places in the area specified by coordinates and search radius
  ☆18Updated 2 years ago
• commoncrawl / cc-crawl-statistics
  Statistics of Common Crawl monthly archives mined from URL index files
  ☆208Updated last week
• XORbit01 / webpalm
  🕸️ Crawl in the web network
  ☆380Updated 10 months ago
• bellingcat / polyphemus
  Scraper for Odysee: alt-tech platform for sharing video
  ☆18Updated 2 years ago
• pzaino / thecrowler
  A Content Discovery and Development Platform. Empowering Cybersecurity, AI, Marketing, and Finance professionals and researchers to disco…
  ☆51Updated this week
• GONZOsint / factcheckexplorer
  FactCheckExplorer library provides an easy-to-use Python interface for querying and fetching fact-checking data from Google's Fact Check …
  ☆15Updated last year
• MischaU8 / spevktator
  An open source investigation tool to collect and analyse public VK community wall posts
  ☆35Updated 3 years ago