danhje / dead-link-crawlerLinks
An efficient, asynchronous crawler that identifies broken links on a given domain.
☆14Updated 6 months ago
Alternatives and similar repositories for dead-link-crawler
Users that are interested in dead-link-crawler are comparing it to the libraries listed below
Sorting:
- The (new) discovery backend for https://odcrawler.xyz☆30Updated 2 years ago
- Extract all internal and external links from a URL in Python.☆15Updated 2 years ago
- Change detection with a simple Python script to email you whenever a website changes.☆59Updated last year
- An api to check social media username availability on a variety of services☆31Updated 2 years ago
- Set of bots for scraping URLs from Discord, Telegram, Reddit, and IRC.☆109Updated 5 years ago
- Downloads websites for long-term archival.☆67Updated this week
- A frontend for ODCrawler, an Open Directory search engine.☆38Updated 2 years ago
- Search google, bing, yahoo, and other search engines with python☆59Updated 3 years ago
- Small, dependency-free, fast Python package for removing tracking fields from URLs.☆38Updated 2 years ago
- 🛡️📧 Protect e-mails against spam and scraping bots☆33Updated 6 months ago
- List of pastebin services☆252Updated 2 months ago
- A simple DuckDuckGo URL scraper.☆26Updated last year
- A search-engine-cli-scraper for more than 15 search engines, including Google. duckduckgo, Bing, Ask, etc...☆21Updated 6 months ago
- [mirror] Backup a list of github starred repositories for the specified user.☆138Updated 2 years ago
- Blocklist of tracking domains used by iOS and popular apps.☆20Updated 4 years ago
- Easy to install, privacy protection browser setup. A collection of best browser extensions and configurations to help you fight for your …☆25Updated 5 years ago
- The tool to check the availability or syntax of domain, IP or URL.☆318Updated last week
- ☆30Updated 5 years ago
- PRE & NFO database and notification service for warez scene releases. This repository contains the frontend code written in Next.js and C…☆32Updated 3 years ago
- https://redditmetis.com☆32Updated 4 years ago
- Examples for using the Pipl SEARCH API☆10Updated last year
- A Chrome Extension for extracting valuable insights from reviews, generating concise summaries, sentiment analysis, and keyword extractio…☆33Updated 2 years ago
- Generation scripts and source for Tracker Radar Wiki☆69Updated last week
- Scrapes an arbitrary number of lines from a Discord channel☆25Updated 6 years ago
- project to produce various useful scrapers☆30Updated last week
- Frontend code for GitHub Recommendation Extension☆61Updated 2 years ago
- Tool for extracting comments or subtitles from youtube video's☆144Updated 3 years ago
- General purpose DOM/GreaseMonkey library: register listeners for when CSS selectors exist, intercept events, create persistent & synchron…☆21Updated last week
- Grabbing everything from reddit.☆61Updated last year
- A Scraper, Downloader, & Recorder for static open directories.☆17Updated last year