The robots.txt exclusion protocol implementation for Go language
☆288May 25, 2026Updated 4 months ago
Alternatives and similar repositories for robotstxt
Users that are interested in robotstxt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- grobotstxt is a native Go port of Google's robots.txt parser and matcher library.☆115Mar 16, 2022Updated 4 years ago
- A simple and flexible web crawler that follows the robots.txt policies and crawl delays.☆791May 19, 2021Updated 5 years ago
- Go robots.txt parser☆15Nov 27, 2017Updated 8 years ago
- tiny Go library to normalize URLs☆484May 18, 2026Updated 4 months ago
- Polite, slim and concurrent web crawler.☆2,051May 19, 2021Updated 5 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Cgo binding for Snowball C library☆38Jun 27, 2017Updated 9 years ago
- Timeout invocation. Go porting of GNU timeout and able to use as Go package☆76Apr 21, 2019Updated 7 years ago
- Loom - A repository for Weave Files☆26Jun 12, 2015Updated 11 years ago
- Go package to minify HTML (alpha-quality)☆15Mar 30, 2024Updated 2 years ago
- Better `go run`. Build go codes transparently and exec☆16Oct 14, 2018Updated 7 years ago
- A little like that j-thing, only in Go.☆14,989Updated this week
- ☆25Apr 30, 2015Updated 11 years ago
- ASAP smoothing☆13Sep 8, 2017Updated 9 years ago
- A terminal clone of Don't Tap the White Tile, in Go☆11Feb 9, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Golang pkg for URL parsing and normalization☆162Sep 30, 2026Updated last week
- A webcomponent built with stencil to convert audio into text☆11Aug 24, 2018Updated 8 years ago
- A Go package concerning quoted-printable encoding.☆20Jul 16, 2015Updated 11 years ago
- (GitHub) Pkg Critic is a tool combining search results from GoDoc API and stats info from GitHub API.☆15Mar 14, 2016Updated 10 years ago
- Go library to run http servers on top of stripe's einhorn.☆10Oct 22, 2015Updated 10 years ago
- Defensive lemmatiser/stemmer written in Go ⊂( ⚆ ϖ⚆)っ☆15May 22, 2023Updated 3 years ago
- dmmclust is a package for clustering short texts, based on Yin and Wang (2014)☆26Dec 13, 2017Updated 8 years ago
- Implementation of "An Optimal Suffix Array Construction Algorithm" described in a Technical Report by Ge Nong☆26Feb 26, 2013Updated 13 years ago
- Simple library for working with passwords in Go (golang).☆13Feb 18, 2016Updated 10 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- CORS middleware for Gin.☆12Aug 31, 2020Updated 6 years ago
- Levenshtein String Distance☆12May 20, 2022Updated 4 years ago
- gofind searches through Go source code by types.☆48Jul 13, 2023Updated 3 years ago
- permutation☆28Oct 14, 2023Updated 2 years ago
- WebLoop: Scriptable, headless WebKit with a Go API. Like PhantomJS, but for Go.☆1,369Apr 1, 2024Updated 2 years ago
- esa client library for API v1 written in golang☆13Aug 15, 2019Updated 7 years ago
- Package gorilla/css is a CSS3 tokenizer.☆92Nov 5, 2023Updated 2 years ago
- general tokenizer/scanner in Go☆42Sep 27, 2024Updated 2 years ago
- A High-Performance Riak Client for Go☆13Sep 22, 2014Updated 12 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Chernyaev’s Marching Cubes 33 is one of the first algorithms intended to preserve the topology of the trilinear interpolant. In this work…☆14Jul 19, 2013Updated 13 years ago
- Minimal cgo bindings for libenca☆19Mar 15, 2016Updated 10 years ago
- CGo bindings to Yandex.Mystem☆36Oct 5, 2016Updated 10 years ago
- NIfTI support for Javascript☆14Mar 18, 2022Updated 4 years ago
- DICOM to NIfTI/BIDS validation script☆12Jun 20, 2026Updated 3 months ago
- A Golang library for text processing, including tokenization, part-of-speech tagging, and named-entity extraction.☆3,089Jul 29, 2026Updated 2 months ago
- Tools to help golang projects audit dependencies, check licenses, and create bill-of-materials☆16Jul 31, 2017Updated 9 years ago