danhje / dead-link-crawlerLinks
An efficient, asynchronous crawler that identifies broken links on a given domain.
☆14Updated last year
Alternatives and similar repositories for dead-link-crawler
Users that are interested in dead-link-crawler are comparing it to the libraries listed below
Sorting:
- The (new) discovery backend for https://odcrawler.xyz☆37Updated 2 years ago
- A frontend for ODCrawler, an Open Directory search engine.☆44Updated 2 years ago
- Collection of scrapers for various websites☆51Updated 2 years ago
- An api to check social media username availability on a variety of services☆32Updated 3 years ago
- Lynx - Link and bookmark manager and sharing platform for the wide web. Next.js, Node.js + Hyper Express, Nx☆27Updated 2 years ago
- Downloads websites for long-term archival.☆82Updated last week
- Change detection with a simple Python script to email you whenever a website changes.☆59Updated 2 years ago
- Backend code for GitHub Recommendation Extension☆28Updated 3 years ago
- Successor to https://github.com/jetkai/ProxyBuilder - Uses Spring & Netty for testing proxies, interacting with a local MariaDB.☆19Updated 2 years ago
- A server to collect & archive websites that also supports video downloads☆84Updated 2 years ago
- [mirror] Backup a list of github starred repositories for the specified user.☆143Updated 2 years ago
- Archive a reddit user's post history. Formatted overview of a profile, JSON containing every post, and picture downloads. Uses the pushs…☆52Updated 3 years ago
- Generate Bookmarks export file (html) of the github user's starred repos☆71Updated 9 years ago
- Scraping similarweb with pywinauto☆22Updated 5 years ago
- Import data from Google Takeout to search and analyze☆17Updated 3 years ago
- Search google, bing, yahoo, and other search engines with python☆61Updated 4 years ago
- A search-engine-cli-scraper for more than 15 search engines, including Google. duckduckgo, Bing, Ask, etc...☆25Updated 5 months ago
- project to produce various useful scrapers☆33Updated 2 months ago
- Facebook search engine that works after the Graph API has been shut down☆103Updated 4 years ago
- Examples for using the Pipl SEARCH API☆11Updated 2 years ago
- Set of bots for scraping URLs from Discord, Telegram, Reddit, and IRC.☆113Updated 5 years ago
- 🔍 Reverse search an image on every search engine☆43Updated 5 years ago
- An Online Collection of Open Source Intelligence Tools☆12Updated 2 years ago
- Template for making Userscripts in TypeScript with various utilities like directly importing and parsing HTML, Markdown and CSS and packi…☆23Updated 2 weeks ago
- https://redditmetis.com☆33Updated 5 years ago
- Generate an RSS file from Telegram channel podcasts list☆15Updated last week
- ☆32Updated 5 years ago
- Lookup phone numbers’ carriers by screen-scraping FreeCarrierLookup.com☆20Updated 4 months ago
- A web app that lets you read articles on popular news sites that get hidden behind paywalls☆45Updated 4 months ago
- Scrape VK URLs to fetch info and media - python API or command line tool.☆51Updated 8 months ago