PuerkitoBio / fetchbot
A simple and flexible web crawler that follows the robots.txt policies and crawl delays.
☆789Updated 4 years ago
Alternatives and similar repositories for fetchbot
Users that are interested in fetchbot are comparing it to the libraries listed below
Sorting:
- Polite, slim and concurrent web crawler.☆2,048Updated 4 years ago
- A Go middleware that stores various information about your web application (response time, status code count, etc.)☆593Updated 2 years ago
- a build tool for Go, with a focus on cross-compiling, packaging and deployment☆1,671Updated 5 years ago
- Reflectionless data binding for Go's net/http (not actively maintained)☆792Updated 7 years ago
- A Go framework for building JSON web services inspired by Dropwizard☆992Updated 6 years ago
- A persistent and flexible background jobs library for go.☆498Updated 6 years ago
- WebLoop: Scriptable, headless WebKit with a Go API. Like PhantomJS, but for Go.☆1,371Updated last year
- An app that displays updates for the Go packages in your GOPATH.☆897Updated last year
- a toolkit for creating plugins for Go applications☆772Updated last year
- A light libxml wrapper for Go☆606Updated last year
- github.com/cznic/ql has moved to modernc.org/ql☆1,301Updated 6 years ago
- Fast Go decoder for dynamic JSON☆598Updated 8 years ago
- simple json field access for golang☆589Updated 4 years ago
- golang database modelling library☆483Updated 6 years ago
- A linter that suggests interface types☆688Updated 6 years ago
- tiny Go library to normalize URLs☆481Updated last year
- Graceful is a Go package enabling graceful shutdown of an http.Handler server.☆1,283Updated 6 years ago
- Lightning Fast HTTP Multiplexer☆1,287Updated 6 years ago
- A visual interface to work with runtime profiling data for Go☆1,285Updated 3 years ago
- Golang Natural Language Processing☆834Updated 2 years ago
- JSONAPI.org Implementation for Go☆712Updated 10 months ago
- Minimal and simple request library for Go language☆680Updated 6 years ago
- Cheat sheet for some of the common concurrent flows in Go☆1,203Updated 9 years ago
- A simple, higher level interface for Go web scraping.☆1,512Updated 8 years ago
- A polite Go HTTP server that shuts down gracefully.☆996Updated 6 years ago
- Authentication framework for Go applications.☆642Updated 6 years ago
- A Go (golang) based Elasticsearch client library.☆942Updated 6 years ago
- conversion between sql and structs in go☆541Updated 4 years ago
- Lion is a fast HTTP router for building modern scalable modular REST APIs in Go☆742Updated 5 years ago
- Simple, fast and scalable golang rpc library for high load☆707Updated 2 years ago