danhje / dead-link-crawlerLinks
An efficient, asynchronous crawler that identifies broken links on a given domain.
☆14Updated 9 months ago
Alternatives and similar repositories for dead-link-crawler
Users that are interested in dead-link-crawler are comparing it to the libraries listed below
Sorting:
- The (new) discovery backend for https://odcrawler.xyz☆34Updated 2 years ago
- A frontend for ODCrawler, an Open Directory search engine.☆41Updated 2 years ago
- Downloads websites for long-term archival.☆73Updated last week
- Lookup phone numbers’ carriers by screen-scraping FreeCarrierLookup.com☆20Updated 3 weeks ago
- Examples for using the Pipl SEARCH API☆10Updated last year
- Collection of scrapers for various websites☆51Updated last year
- Set of bots for scraping URLs from Discord, Telegram, Reddit, and IRC.☆112Updated 5 years ago
- An api to check social media username availability on a variety of services☆32Updated 2 years ago
- Change detection with a simple Python script to email you whenever a website changes.☆59Updated 2 years ago
- An Online Collection of Open Source Intelligence Tools☆13Updated 2 years ago
- 🔍 Reverse search an image on every search engine☆43Updated 5 years ago
- Generate Bookmarks export file (html) of the github user's starred repos☆71Updated 8 years ago
- [mirror] Backup a list of github starred repositories for the specified user.☆140Updated 2 years ago
- Simple TikTok Video / Photo Downloader☆45Updated 6 months ago
- Python script to download videos from a TikTok profile without any watermarks.☆118Updated 5 years ago
- ☆32Updated 5 years ago
- Successor to https://github.com/jetkai/ProxyBuilder - Uses Spring & Netty for testing proxies, interacting with a local MariaDB.☆20Updated 2 years ago
- Web application for managing and scraping individual videos from a couple various porn sites. Currently supports PornHub, PornTrex, PornW…☆35Updated 2 years ago
- Generates new porn descriptions based on an edited dataset of xhamster video descriptions uploaded between 2007-2016.☆55Updated 9 months ago
- Lynx - Link and bookmark manager and sharing platform for the wide web. Next.js, Node.js + Hyper Express, Nx☆26Updated 2 years ago
- A tiny data wiping library and tool.☆24Updated 3 years ago
- A Bot that searches for and posts links to archived versions of articles after scanning all of HackerNews' top articles for those that co…☆23Updated 3 years ago
- A command-line tool to bulk check a list of usernames on various social media services☆63Updated 5 years ago
- Archive a reddit user's post history. Formatted overview of a profile, JSON containing every post, and picture downloads. Uses the pushs…☆53Updated 3 years ago
- ☆63Updated 9 months ago
- Web-tool to search YouTube for geographically tagged videos by channel, topic, and location. Videos are viewable in a map and exportabled…☆145Updated 9 months ago
- Script to check multiple registered accounts in mega.nz cloud using the suite megatools☆13Updated 5 years ago
- TikTok channel bulk ripper based on TikTok-Api and Youtube-dl. Some assembly may be required.☆36Updated 2 years ago
- Backend code for GitHub Recommendation Extension☆28Updated 3 years ago
- Email productivity.☆17Updated 9 months ago