danhje / dead-link-crawlerLinks
An efficient, asynchronous crawler that identifies broken links on a given domain.
☆14Updated 11 months ago
Alternatives and similar repositories for dead-link-crawler
Users that are interested in dead-link-crawler are comparing it to the libraries listed below
Sorting:
- The (new) discovery backend for https://odcrawler.xyz☆36Updated 2 years ago
- A frontend for ODCrawler, an Open Directory search engine.☆42Updated 2 years ago
- Collection of scrapers for various websites☆51Updated last year
- Generation scripts and source for Tracker Radar Wiki☆76Updated last week
- 🔍 Reverse search an image on every search engine☆43Updated 5 years ago
- [mirror] Backup a list of github starred repositories for the specified user.☆142Updated 2 years ago
- Set of bots for scraping URLs from Discord, Telegram, Reddit, and IRC.☆112Updated 5 years ago
- A tiny data wiping library and tool.☆24Updated 4 years ago
- Small, dependency-free, fast Python package for removing tracking fields from URLs.☆38Updated 3 years ago
- ☆32Updated 5 years ago
- Successor to https://github.com/jetkai/ProxyBuilder - Uses Spring & Netty for testing proxies, interacting with a local MariaDB.☆20Updated 2 years ago
- Blocklist of tracking domains used by iOS and popular apps.☆21Updated 5 years ago
- Change detection with a simple Python script to email you whenever a website changes.☆59Updated 2 years ago
- A Scraper, Downloader, & Recorder for static open directories.☆17Updated last year
- Image downloader for various imageboards and image albums written in Python.☆10Updated 6 years ago
- Wistalk : Analyze Wikipedia User's Activity☆25Updated 5 months ago
- Easy to install, privacy protection browser setup. A collection of best browser extensions and configurations to help you fight for your …☆26Updated 5 years ago
- Downloads websites for long-term archival.☆79Updated last week
- Centralize, view, edit, label and organize collections of your favorite URLs 🔗 📙☆39Updated 3 years ago
- Media Bias Fact Check extension☆41Updated 2 weeks ago
- Grabbing everything from reddit.☆61Updated last year
- Find open directories using Open Directory Search Tool☆35Updated 6 years ago
- A server to collect & archive websites that also supports video downloads☆84Updated 2 years ago
- LyricsMaster is a library for downloading lyrics from multiple lyrics providers.☆24Updated 5 months ago
- A youtube-dl extension with pluggable extractors☆53Updated 8 months ago
- A search-engine-cli-scraper for more than 15 search engines, including Google. duckduckgo, Bing, Ask, etc...☆25Updated 3 months ago
- Backend code for GitHub Recommendation Extension☆28Updated 3 years ago
- Generate Bookmarks export file (html) of the github user's starred repos☆71Updated 8 years ago
- An Online Collection of Open Source Intelligence Tools☆12Updated 2 years ago
- Pages saved with SingleFile☆14Updated last year