maciekmm / sitemap-generatorLinks
A highly concurrent Go solution to build sitemaps. Features CLI, proxy support, rate limiting, robots.txt compliant, url filtering and many other features.
☆23Updated 9 years ago
Alternatives and similar repositories for sitemap-generator
Users that are interested in sitemap-generator are comparing it to the libraries listed below
Sorting:
- interactive, configurable content-blocking proxy written in golang☆94Updated 9 years ago
- Golang library to easily scrape websites based on simple XML declarations☆89Updated 10 years ago
- Render screenshots of given urls on Linux using Xvfb, midori, ratpoison & ImageMagick☆83Updated 10 years ago
- Super simple, concurrent worker queue in golang☆68Updated 6 years ago
- dropbox based blog engine, written in go.☆78Updated 7 years ago
- Provides a simple and easy to use worker queue for golang.☆38Updated 10 years ago
- Various parsing utilities, such as IP, time, and top-level-domain, in Go☆25Updated 9 years ago
- Ad hoc Cluster Monitoring Over SSH