jonasjacek / robots.txt
Simple robots.txt template. Keep unwanted robots out (disallow). White lists (allow) legitimate user-agents. Useful for all websites.
☆87Updated 9 months ago
Related projects ⓘ
Alternatives and complementary repositories for robots.txt
- Remove outdated content via https://www.google.com/webmasters/tools/removals in bulk!☆21Updated 3 years ago
- Your guide to Node.js content management systems☆46Updated last month
- INACTIVE - SRI Hash Generator☆151Updated 7 months ago
- Recursive and multi-threaded broken link checker☆33Updated 2 years ago
- Alles was in das <head>-Element einer HTML-Datei kommen kann.☆15Updated 6 years ago
- CloudFlare Workers deployment add-on for WP2Static☆26Updated last year
- SEO Shortcuts — A browser extension for Chrome☆20Updated 2 years ago
- A lightweight caching plugin for WordPress that makes your website faster by generating static HTML files.☆125Updated 5 months ago
- A set of browser-based DNS tools for DigitalOcean Community.☆112Updated this week
- ☆25Updated 4 years ago
- Minimal and sustainable WordPress theme for ChrisWiegman.com. https://chriswiegman.com/☆33Updated last month
- A content delivery network (CDN) integration plugin for WordPress that rewrites URLs, like for CSS, JavaScript, and images, to be served …☆47Updated 5 months ago
- ☆232Updated 3 years ago
- Plugin and modification done to Premium URL Shortener☆50Updated 3 weeks ago
- ShortPixel Image Optimizer WordPress Plugin☆15Updated this week
- Wordpress plugin for serving autogenerated WebP images instead of jpeg/png to browsers that supports WebP☆229Updated 4 months ago
- Migrate from HTTP to HTTPS with ease.☆50Updated 2 years ago
- A simple way to detect adblock☆57Updated 8 years ago
- https://applecensorship.com/☆37Updated 4 years ago
- WordPress plugin that checks the validity of the XML-RPC Endpoint of WordPress sites☆49Updated 4 years ago
- 🚫 💹 🛒WebExtension for Chrome, Firefox, Edge and Opera to remove the Amazon affiliate tracking ID (tag) from amazon links☆63Updated this week
- Chromium's HSTS preload list submission website.☆784Updated 2 months ago
- A chrome extension that purges the CF cache for the current URL of CloudFlare enabled websites☆30Updated 8 months ago
- The official jsDelivr website☆143Updated this week
- Using Cloudflare, Github Actions, Metalsmith (and Github) to Manage Content!☆10Updated last year
- Automatically submit your sitemap after production build☆74Updated last year
- Search profiles on http://nownownow.com☆22Updated 8 years ago
- Inspired/stolen from http://code.lancepollard.com/complete-list-of-html-meta-tags/☆135Updated 5 years ago
- Bulk whois lookup tool☆33Updated 10 months ago