PuerkitoBio / fetchbot
A simple and flexible web crawler that follows the robots.txt policies and crawl delays.
☆790Updated 3 years ago
Alternatives and similar repositories for fetchbot:
Users that are interested in fetchbot are comparing it to the libraries listed below
- Polite, slim and concurrent web crawler.☆2,041Updated 3 years ago
- WebLoop: Scriptable, headless WebKit with a Go API. Like PhantomJS, but for Go.☆1,369Updated last year
- Cheat sheet for some of the common concurrent flows in Go☆1,204Updated 9 years ago
- An app that displays updates for the Go packages in your GOPATH.☆896Updated last year
- a build tool for Go, with a focus on cross-compiling, packaging and deployment☆1,672Updated 5 years ago
- Reflectionless data binding for Go's net/http (not actively maintained)☆794Updated 7 years ago
- A simple, higher level interface for Go web scraping.☆1,511Updated 8 years ago
- a toolkit for creating plugins for Go applications☆769Updated last year
- The robots.txt exclusion protocol implementation for Go language☆273Updated 2 years ago
- A linter that suggests interface types☆688Updated 6 years ago
- A visual interface to work with runtime profiling data for Go☆1,287Updated 3 years ago
- A persistent and flexible background jobs library for go.☆498Updated 6 years ago
- 🔭 Goggles is a cross-platform GUI for your $GOPATH!☆666Updated 7 years ago
- Fast Go decoder for dynamic JSON☆599Updated 7 years ago
- github.com/cznic/ql has moved to modernc.org/ql☆1,303Updated 6 years ago
- tiny Go library to normalize URLs☆480Updated last year
- A Go middleware that stores various information about your web application (response time, status code count, etc.)☆593Updated 2 years ago
- Lightning Fast HTTP Multiplexer☆1,287Updated 5 years ago
- golang build tool in the spirt of rake, gulp☆535Updated 6 years ago
- Graceful is a Go package enabling graceful shutdown of an http.Handler server.☆1,281Updated 6 years ago
- This tool is similar to golang.org/x/tools/cmd/stringer but generates MarshalJSON and UnmarshalJSON methods.☆488Updated 3 years ago
- Naive Bayesian Classification for Golang.☆805Updated last year
- Access OS metrics from Golang,☆457Updated last year
- Golang Natural Language Processing☆833Updated 2 years ago
- Extensions to the standard "os" package. Executable and ExecutableFolder.☆442Updated 6 years ago
- CSS selector library in Go☆724Updated 3 months ago
- gvt was a minimal go vendoring tool, based on gb-vendor. Today, you want to use modules instead.☆725Updated 6 years ago
- Struct Faker for Go☆345Updated 6 years ago
- conversion between sql and structs in go☆541Updated 3 years ago
- Manage TLS certificates automatically via LetsEncrypt.org☆459Updated 5 years ago