danhje / dead-link-crawler
An efficient, asynchronous crawler that identifies broken links on a given domain.
☆14Updated 2 months ago
Alternatives and similar repositories for dead-link-crawler:
Users that are interested in dead-link-crawler are comparing it to the libraries listed below
- Extract all internal and external links from a URL in Python.☆13Updated last year
- Generate an RSS file from Telegram channel podcasts list☆16Updated this week
- The (new) discovery backend for https://odcrawler.xyz☆29Updated 2 years ago
- ☆62Updated 2 months ago
- Email productivity.☆17Updated 2 months ago
- 👩💻 Python extension for the Selenium web driver that makes browser automation even easier 👨💻☆15Updated this week
- A simple docker to torrent within Heroku to transfer the files to your Mega drive.☆12Updated 3 years ago
- Wistalk : Analyze Wikipedia User's Activity☆25Updated 2 years ago
- A search-engine-cli-scraper for more than 15 search engines, including Google. duckduckgo, Bing, Ask, etc...☆21Updated 2 months ago
- Search google, bing, yahoo, and other search engines with python☆56Updated 3 years ago
- Image downloader for various imageboards and image albums written in Python.☆9Updated 5 years ago
- Free Cloud JSON Storage Written in Python☆14Updated 2 years ago
- A personal filterlist of mine with additional filters for Adguard to block third-party, tracking, annoyances, anti-adblock, resource-abus…☆17Updated this week
- A simple DuckDuckGo URL scraper.☆24Updated last year
- ⁉ My personal list of gotchas and other tricky situations with nginx☆19Updated last year
- https://redditmetis.com☆30Updated 4 years ago
- Removes unoriginal YouTube comments.☆24Updated last year
- Encrypt links with base64 and provide a noob-friendly way to decrypt☆16Updated 3 years ago
- Multithreading requests via TOR with automatic TOR new identity☆57Updated last year
- project to produce various useful scrapers☆30Updated last week
- 🔍 Reverse search an image on every search engine☆38Updated 4 years ago
- Personal uBO filter lists☆39Updated 10 months ago
- A youtube-dl extension with pluggable extractors☆49Updated last month
- A request based package for scraping twitter data. No API Key required. Support for proxies and private twitter accounts☆27Updated last year
- Web application for managing and scraping individual videos from a couple various porn sites. Currently supports PornHub, PornTrex, PornW…☆34Updated last year
- Unofficial API for multcloud which supports multiple accounts to remotely upload to GDrive.☆10Updated 3 years ago
- Blocklist compilation and deduplication☆27Updated 2 years ago
- Download all images of any pornstar from pornpics.com☆11Updated 3 years ago
- An open-source live data tracker for Twitch.tv☆23Updated last month