danhje / dead-link-crawler
An efficient, asynchronous crawler that identifies broken links on a given domain.
☆14Updated 2 months ago
Alternatives and similar repositories for dead-link-crawler:
Users that are interested in dead-link-crawler are comparing it to the libraries listed below
- The (new) discovery backend for https://odcrawler.xyz☆29Updated 2 years ago
- Change detection with a simple Python script to email you whenever a website changes.☆58Updated last year
- Extract all internal and external links from a URL in Python.☆13Updated last year
- ☆62Updated 2 months ago
- Email productivity.☆17Updated 2 months ago
- Search google, bing, yahoo, and other search engines with python☆56Updated 3 years ago
- Wistalk : Analyze Wikipedia User's Activity☆25Updated 2 years ago
- Blocklist of tracking domains used by iOS and popular apps.☆20Updated 4 years ago
- https://redditmetis.com☆30Updated 4 years ago
- Python utility to archive and keep up-to-date archives of reddit subreddits. Archives to SQLite databases.☆29Updated last year
- List of Custom Search Engines☆30Updated 4 years ago
- A simple DuckDuckGo URL scraper.☆24Updated last year
- A tiny data wiping library and tool.☆22Updated 3 years ago
- 📒 Quick script to generate a table of contents from a markdown document☆15Updated last year
- Get info about accounts of ok.ru by phone number / email address☆14Updated 5 months ago
- Image downloader for various imageboards and image albums written in Python.☆9Updated 5 years ago
- Columbia by Osborne · A comprehensive black hole for ads and analytics☆8Updated last year
- The tool to check the availability or syntax of domain, IP or URL.☆307Updated last week
- Simple URL shortener and redirector/dereferrer script☆9Updated 3 years ago
- A frontend for ODCrawler, an Open Directory search engine.☆36Updated 2 years ago
- Blocklist compilation and deduplication☆26Updated 2 years ago
- A Minimal Yet Powerful Crawler for Extracting all The Internal/External/Fuzz-able Links from a website☆32Updated 6 years ago
- command-line tool to filter expiring domains by configurable criteria☆17Updated 2 years ago
- Collection of scrapers for various websites☆50Updated last year
- Show Letterboxd rating on imdb.com, metacritic.com, rottentomatoes.com, BoxOfficeMojo, Amazon, Google Play, allmovie.com, Wikipedia, them…☆16Updated 11 months ago
- Network/host scanner and information gatherer☆25Updated last year
- 🔍 Reverse search an image on every search engine☆38Updated 4 years ago
- CLI OSINT app that can fetch data from Instagram's Web API without authentication.☆62Updated last year
- Centralize, view, edit, label and organize collections of your favorite URLs 🔗 📙☆38Updated 2 years ago