PuerkitoBio / fetchbot
A simple and flexible web crawler that follows the robots.txt policies and crawl delays.
☆789Updated 3 years ago
Alternatives and similar repositories for fetchbot:
Users that are interested in fetchbot are comparing it to the libraries listed below
- Polite, slim and concurrent web crawler.☆2,045Updated 3 years ago
- WebLoop: Scriptable, headless WebKit with a Go API. Like PhantomJS, but for Go.☆1,370Updated last year
- A linter that suggests interface types☆688Updated 6 years ago
- A Go framework for building JSON web services inspired by Dropwizard☆991Updated 6 years ago
- A persistent and flexible background jobs library for go.☆498Updated 6 years ago
- A Go middleware that stores various information about your web application (response time, status code count, etc.)☆593Updated 2 years ago
- A visual interface to work with runtime profiling data for Go☆1,286Updated 3 years ago
- Lightning Fast HTTP Multiplexer☆1,288Updated 5 years ago
- a build tool for Go, with a focus on cross-compiling, packaging and deployment☆1,672Updated 5 years ago
- Fast Go decoder for dynamic JSON☆599Updated 7 years ago
- Is a lightweight, fast and extensible zero allocation HTTP router for Go used to create customizable frameworks.☆384Updated 5 years ago
- Instrument your web apps with logging and metrics☆522Updated 2 years ago
- Go Postgres Data Access Toolkit☆608Updated 4 years ago
- A simple, higher level interface for Go web scraping.☆1,513Updated 8 years ago
- Cheat sheet for some of the common concurrent flows in Go☆1,204Updated 9 years ago
- The robots.txt exclusion protocol implementation for Go language☆274Updated 2 years ago
- An app that displays updates for the Go packages in your GOPATH.☆897Updated last year
- Reflectionless data binding for Go's net/http (not actively maintained)☆793Updated 7 years ago
- Elegant WebSockets in Go☆510Updated 9 years ago
- a toolkit for creating plugins for Go applications☆771Updated last year
- Like Go channels over the network☆2,463Updated 6 years ago
- A light libxml wrapper for Go☆605Updated last year
- Graceful is a Go package enabling graceful shutdown of an http.Handler server.☆1,282Updated 6 years ago
- Barebones dependency manager for Go.☆1,184Updated 7 years ago
- Minimal and simple request library for Go language☆680Updated 6 years ago
- BadActor.org An in-memory application driven jailer written in Go☆324Updated 4 years ago
- gvt was a minimal go vendoring tool, based on gb-vendor. Today, you want to use modules instead.☆725Updated 6 years ago
- golang build tool in the spirt of rake, gulp☆535Updated 7 years ago
- JSONAPI.org Implementation for Go☆711Updated 10 months ago
- tiny Go library to normalize URLs☆481Updated last year