PuerkitoBio / fetchbot
A simple and flexible web crawler that follows the robots.txt policies and crawl delays.
☆787Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for fetchbot
- Polite, slim and concurrent web crawler.☆2,037Updated 3 years ago
- WebLoop: Scriptable, headless WebKit with a Go API. Like PhantomJS, but for Go.☆1,370Updated 7 months ago
- A visual interface to work with runtime profiling data for Go☆1,292Updated 2 years ago
- Fast Go decoder for dynamic JSON☆597Updated 7 years ago
- A persistent and flexible background jobs library for go.☆502Updated 6 years ago
- Cheat sheet for some of the common concurrent flows in Go☆1,210Updated 9 years ago
- A Go framework for building JSON web services inspired by Dropwizard☆994Updated 6 years ago
- a build tool for Go, with a focus on cross-compiling, packaging and deployment☆1,676Updated 5 years ago
- A linter that suggests interface types☆691Updated 6 years ago
- A simple, higher level interface for Go web scraping.☆1,513Updated 7 years ago
- a toolkit for creating plugins for Go applications☆765Updated 7 months ago
- A Go middleware that stores various information about your web application (response time, status code count, etc.)☆594Updated last year
- Fast conversions across various Go types with a simple API.☆385Updated 3 years ago
- simple json field access for golang☆586Updated 4 years ago
- tiny Go library to normalize URLs☆474Updated 8 months ago
- Is a lightweight, fast and extensible zero allocation HTTP router for Go used to create customizable frameworks.☆385Updated 5 years ago
- An app that displays updates for the Go packages in your GOPATH.☆899Updated 11 months ago
- Reflectionless data binding for Go's net/http (not actively maintained)☆795Updated 6 years ago
- Persistent stacks and queues for Go backed by LevelDB☆862Updated 4 years ago
- Graceful is a Go package enabling graceful shutdown of an http.Handler server.☆1,283Updated 6 years ago
- CSS selector library in Go☆703Updated last year
- github.com/cznic/ql has moved to modernc.org/ql☆1,305Updated 6 years ago
- Authentication framework for Go applications.☆640Updated 5 years ago
- Lion is a fast HTTP router for building modern scalable modular REST APIs in Go☆743Updated 5 years ago
- Zero-downtime restarts in Go☆2,097Updated 5 years ago
- Elegant WebSockets in Go☆512Updated 8 years ago
- The robots.txt exclusion protocol implementation for Go language☆270Updated 2 years ago
- Package httpcontrol allows for HTTP transport level control around timeouts and retries.☆463Updated 9 years ago
- DRY (don't repeat yourself) package for Go☆487Updated last year
- Lightning Fast HTTP Multiplexer☆1,288Updated 5 years ago