eywu / goodbots
Verify IP addresses of respectful crawlers like Googlebot by reverse dns and forward dns lookups
☆34Updated last month
Alternatives and similar repositories for goodbots
Users that are interested in goodbots are comparing it to the libraries listed below
Sorting:
- Automated git alias management☆21Updated last year
- a tool for validate xml sitemap and sitemap index files for broken links☆40Updated 2 years ago
- Checkpoint 401 Forward Auth Security Server.☆16Updated 11 months ago
- Change case of text using the command line: upper-case, lower-case, title-case, camel-case, kebab-case, snake-case☆17Updated last month
- ☆12Updated 2 months ago
- 🔥 Helper program for setting up a Firecracker microVM on a fresh metal☆23Updated last year
- OpenFaaS template for headless Chrome and Puppeteer☆91Updated last year
- Docker image for ScreamingFrog version 16☆31Updated 3 years ago
- ThreatBite is a real-time service that detects unwanted web users.☆91Updated 3 years ago
- Easy .ovpn files import/generation tool☆29Updated 5 years ago
- Create a gif from a youtube video with subtitles enabled, using yt-dlp and ffmpeg☆59Updated 8 months ago
- universal messaging & notifications gateway☆25Updated last year
- A Python framework to build polite, but tenacious crawlers / scrapers with a MariaDB backend☆21Updated last year
- A template tool with no dependencies that works like Helm templates or Consul templates.☆16Updated 3 weeks ago
- Script to automate Cloudflare ELS logs into Google BigQuery and Google Data Studio☆12Updated 7 months ago
- Virtual filesystem for Caddy using git repo as backend☆20Updated 9 months ago
- Inspired by patchbay.pub☆63Updated 3 years ago
- Sup.js saves URL parameters and inputs them into any form submitted during a visitors session on you site.☆86Updated 2 years ago
- Collects events from SQL Server and saves them to Elasticsearch for further analysis.☆35Updated 2 months ago
- Prototypes of web stacks☆18Updated last year
- Grub is an AI powered Web crawler.☆19Updated 2 years ago
- A Go CLI program sends a prompt to the ChatGPT API for several models, prints the generated response for each, and then sends all the res…☆25Updated 2 years ago
- ☆42Updated last year
- Convert your README.md into a documentation site (via mdBook)☆17Updated last year
- Content Extraction using the PageRank algorithm to find the element containing the best content.☆12Updated 5 years ago
- Python Script to Download Universal Analytics Data☆11Updated 10 months ago
- HandyDash is a cross-platform HTTP, TCP, and IP monitoring tool, intended for desktop use. It is agent free, requires no installation, an…☆16Updated 9 months ago
- Email Enricher is a free, offline alternative to Clearbit for enriching emails. Determine if an email likely belongs to a Fortune 1000 co…☆17Updated last year
- Owl is an open-source self-hosted solution for website monitoring and status report.☆24Updated 2 years ago
- A collection of raw STMP server responses from major email service providers and spam filter services.☆53Updated 2 months ago