tbrianjones / website_extractor
This is an In-Memory Web Crawler & Scraper built to extract data in small runs from public websites. The current implementation takes a .csv of urls and crawls the sites, extracting basic info about the site like emails, phone numbers, addresses, & specified terms.
☆10Updated 9 years ago
Alternatives and similar repositories for website_extractor:
Users that are interested in website_extractor are comparing it to the libraries listed below
- Wordpress.org svn repositories spider☆12Updated 10 years ago
- Checks to see when the cert for a given domain expires.☆18Updated 2 years ago
- Local Transforms for the Maltego OSINT investigative tool that act on FetLife.com.☆40Updated 4 years ago
- 👨👩👧👦 (Rest) API to extract social media profiles from websites or specific URLs☆19Updated 2 years ago
- A Chrome extension for executing some Graph-like searches against Facebook.☆18Updated 5 years ago
- Simple web crawler to crawl website and organise URLs based on page extensions.☆15Updated 5 years ago
- A small Php package to fetch archive url snapshots from archive.org. Using it you can fetch complete list of snapshot urls of any year or…☆19Updated 3 years ago
- ☆14Updated 6 years ago
- Transform to check if email is registered on Facebook.com☆22Updated 12 years ago
- ☆41Updated 6 years ago
- Discord Scripts☆12Updated 5 years ago
- A simple script for translating IP addresses to GeoLocations☆40Updated 2 years ago
- Share wifi on windows with arranged password like every hour or every day☆15Updated 8 years ago
- 👨👩👦 Social account detection and extraction in Python, e.g. for crawling/scraping.☆46Updated 2 years ago
- A collection of Open Data for the data freaks out there.☆37Updated 7 years ago
- Secure FTP☆10Updated 6 years ago
- A simple site cloner☆25Updated 7 years ago
- Sniff every types of files you want on your network interface and save it.☆16Updated 9 years ago
- A simple Python tool to harvest email addresses from Google.☆15Updated 10 years ago
- yellow pages email harvester☆15Updated 7 years ago
- Foxss is a simple php based penetration Testing Tool.Currently it will help to find XSS vulnerability in websites.☆37Updated 6 years ago
- A simple Golang program to collect proxies☆12Updated 5 years ago
- A tool for the persistent XSS exploitation with a focus for mobile web browsers☆54Updated 3 years ago
- I created my own Keylogger I am going to open source its code .But no one is allowed to use it commercially and I have actual copy right…☆12Updated 7 years ago
- Scripts to automate Open Source Intelligence (OSINT)☆15Updated 5 years ago
- Generate word list by combining inputted words or by permutaing characters.☆13Updated 7 years ago
- hack tools☆15Updated 6 years ago
- Maltego Integration of https://www.fullcontact.com/ @FullContact☆27Updated 2 years ago
- A repository for personal tracking.☆15Updated 2 years ago
- Tool to automatic leak information using Hacking with engine searches☆92Updated 6 years ago