The robots.txt exclusion protocol implementation for Go language
☆285Feb 19, 2026Updated last month
Alternatives and similar repositories for robotstxt
Users that are interested in robotstxt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- grobotstxt is a native Go port of Google's robots.txt parser and matcher library.☆115Mar 16, 2022Updated 4 years ago
- Go robots.txt parser☆15Nov 27, 2017Updated 8 years ago
- A simple and flexible web crawler that follows the robots.txt policies and crawl delays.☆790May 19, 2021Updated 4 years ago
- tiny Go library to normalize URLs☆485Mar 19, 2024Updated 2 years ago
- Polite, slim and concurrent web crawler.☆2,053May 19, 2021Updated 4 years ago
- Mutation testing for Go☆27Mar 17, 2013Updated 13 years ago
- Better `go run`. Build go codes transparently and exec☆16Oct 14, 2018Updated 7 years ago
- Timeout invocation. Go porting of GNU timeout and able to use as Go package☆75Apr 21, 2019Updated 6 years ago
- Generate Go structs from JSON!☆42May 1, 2013Updated 12 years ago
- Cgo binding for Snowball C library☆38Jun 27, 2017Updated 8 years ago
- Loom - A repository for Weave Files☆26Jun 12, 2015Updated 10 years ago
- A little like that j-thing, only in Go.☆14,921Mar 15, 2026Updated last week
- ☆25Apr 30, 2015Updated 10 years ago
- gofind searches through Go source code by types.☆48Jul 13, 2023Updated 2 years ago
- A terminal clone of Don't Tap the White Tile, in Go☆11Feb 9, 2019Updated 7 years ago
- general tokenizer/scanner in Go☆42Sep 27, 2024Updated last year
- Go package to minify HTML (alpha-quality)☆15Mar 30, 2024Updated last year
- ASAP smoothing☆13Sep 8, 2017Updated 8 years ago
- Golang pkg for URL parsing and normalization☆162Jun 22, 2022Updated 3 years ago
- CGo wrapper package around the libtidy, the HTML tidy library☆22Nov 19, 2021Updated 4 years ago
- A webcomponent built with stencil to convert audio into text☆11Aug 24, 2018Updated 7 years ago
- Go library to run http servers on top of stripe's einhorn.☆10Oct 22, 2015Updated 10 years ago
- Defensive lemmatiser/stemmer written in Go ⊂( ⚆ ϖ⚆)っ☆13May 22, 2023Updated 2 years ago
- WebLoop: Scriptable, headless WebKit with a Go API. Like PhantomJS, but for Go.☆1,366Apr 1, 2024Updated last year
- (GitHub) Pkg Critic is a tool combining search results from GoDoc API and stats info from GitHub API.☆15Mar 14, 2016Updated 10 years ago
- A Go package concerning quoted-printable encoding.☆20Jul 16, 2015Updated 10 years ago
- Levenshtein String Distance☆12May 20, 2022Updated 3 years ago
- Hawk authentication implementation in Go☆75Nov 28, 2018Updated 7 years ago
- CORS middleware for Gin.☆13Aug 31, 2020Updated 5 years ago
- esa client library for API v1 written in golang☆13Aug 15, 2019Updated 6 years ago
- dmmclust is a package for clustering short texts, based on Yin and Wang (2014)☆26Dec 13, 2017Updated 8 years ago
- A Golang library for text processing, including tokenization, part-of-speech tagging, and named-entity extraction.☆3,069May 2, 2023Updated 2 years ago
- permutation☆28Oct 14, 2023Updated 2 years ago
- Minimal cgo bindings for libenca☆19Mar 15, 2016Updated 10 years ago
- CSS selector library in Go☆753Dec 19, 2024Updated last year
- Chernyaev’s Marching Cubes 33 is one of the first algorithms intended to preserve the topology of the trilinear interpolant. In this work…☆14Jul 19, 2013Updated 12 years ago
- NIfTI support for Javascript☆14Mar 18, 2022Updated 4 years ago
- DICOM to NIfTI/BIDS validation script☆12May 1, 2025Updated 10 months ago
- Html Content / Article Extractor in Golang☆450Aug 3, 2025Updated 7 months ago