bartdag / pylinkvalidator
pylinkvalidator is a standalone and pure python link validator and crawler that traverses a web site and reports errors (e.g., 500 and 404 errors) encountered.
☆144Updated 6 years ago
Alternatives and similar repositories for pylinkvalidator
Users that are interested in pylinkvalidator are comparing it to the libraries listed below
Sorting:
- A library to interface with the Linkscape API.☆40Updated 6 years ago
- Python bot that crawls your website looking for dead stuff☆43Updated 2 years ago
- A Python client library for GTmetrix REST API☆32Updated 2 years ago
- Uses Screaming Frog Internal HTML with text extraction along with a shingling algorithm to compare content duplication across the pages o…☆43Updated 5 years ago
- Console program to get global ranking for a given website or domain☆21Updated 2 years ago
- A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.☆109Updated 11 months ago
- ☆49Updated 2 years ago
- A simple library for querying U.S. zipcodes.☆79Updated 3 months ago
- A simple python tool that generates a requests/bs4 based web scraper☆26Updated 2 years ago
- A simple website testing tool written in Python.☆16Updated last year
- Extends zip() and itertools.zip_longest() to generate named tuples.☆22Updated 6 years ago
- Tools that will make writing tests, bots and scrapers using Selenium much easier☆140Updated 5 months ago
- A Python module for parsing spintax, unlike any other module this works with nested spintax and also allows the user to escape the specia…☆108Updated 3 years ago
- A minimalistic news aggregator built with Flask and powered by News API.☆76Updated last year
- Automate The Boring Stuff: Updating WordPress☆12Updated 3 years ago
- Docker-based Python web stack (works for Django)☆60Updated this week
- advertools crawler UI☆28Updated 2 years ago
- The simplest way to build Amazon Affiliate links, in Python.☆105Updated 3 years ago
- SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type …☆263Updated 2 years ago
- A crawler for automated functional testing of a web application☆73Updated 2 years ago
- Create Bootstrap 4 web pages using purely Python.☆19Updated last week
- Google/Excel Sheets API Python.☆70Updated 8 months ago
- Scrapy downloader middleware that stores response HTMLs to disk.☆18Updated last year
- A wrapper for the Google Search Console API.☆228Updated last year
- Google rank checker for real time bulk checking SEO keywords☆33Updated 2 years ago
- Scrapy middleware which allows to crawl only new content☆80Updated 2 years ago
- Machine Learning Toolkit for SEO☆139Updated 3 years ago
- Dockerfiles for Python + Selenium in headless Chrome or Firefox☆107Updated 6 years ago
- Ultimate Website Sitemap Parser☆208Updated 2 weeks ago
- A Python script to gain some insights from a domain and list of keywords.☆49Updated last year