The robots.txt exclusion protocol implementation for Go language
☆285Apr 1, 2026Updated last month
Alternatives and similar repositories for robotstxt
Users that are interested in robotstxt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- grobotstxt is a native Go port of Google's robots.txt parser and matcher library.☆115Mar 16, 2022Updated 4 years ago
- A simple and flexible web crawler that follows the robots.txt policies and crawl delays.☆791May 19, 2021Updated 5 years ago
- tiny Go library to normalize URLs☆485May 18, 2026Updated last week
- Polite, slim and concurrent web crawler.☆2,053May 19, 2021Updated 5 years ago
- Mutation testing for Go☆27Mar 17, 2013Updated 13 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Better `go run`. Build go codes transparently and exec☆16Oct 14, 2018Updated 7 years ago
- Timeout invocation. Go porting of GNU timeout and able to use as Go package☆75Apr 21, 2019Updated 7 years ago
- Generate Go structs from JSON!☆42May 1, 2013Updated 13 years ago
- Cgo binding for Snowball C library☆38Jun 27, 2017Updated 8 years ago
- Loom - A repository for Weave Files☆26Jun 12, 2015Updated 10 years ago
- A little like that j-thing, only in Go.☆14,941May 14, 2026Updated last week
- ☆25Apr 30, 2015Updated 11 years ago
- gofind searches through Go source code by types.☆48Jul 13, 2023Updated 2 years ago
- A terminal clone of Don't Tap the White Tile, in Go☆11Feb 9, 2019Updated 7 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- general tokenizer/scanner in Go☆42Sep 27, 2024Updated last year
- Go package to minify HTML (alpha-quality)☆15Mar 30, 2024Updated 2 years ago
- ASAP smoothing☆13Sep 8, 2017Updated 8 years ago
- Golang pkg for URL parsing and normalization☆162Jun 22, 2022Updated 3 years ago
- CGo wrapper package around the libtidy, the HTML tidy library☆22Nov 19, 2021Updated 4 years ago
- A webcomponent built with stencil to convert audio into text☆11Aug 24, 2018Updated 7 years ago
- Go library to run http servers on top of stripe's einhorn.☆10Oct 22, 2015Updated 10 years ago
- Defensive lemmatiser/stemmer written in Go ⊂( ⚆ ϖ⚆)っ☆15May 22, 2023Updated 3 years ago
- WebLoop: Scriptable, headless WebKit with a Go API. Like PhantomJS, but for Go.☆1,368Apr 1, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- (GitHub) Pkg Critic is a tool combining search results from GoDoc API and stats info from GitHub API.☆15Mar 14, 2016Updated 10 years ago
- A Go package concerning quoted-printable encoding.☆20Jul 16, 2015Updated 10 years ago
- Levenshtein String Distance☆12May 20, 2022Updated 4 years ago
- Hawk authentication implementation in Go☆75Nov 28, 2018Updated 7 years ago
- CORS middleware for Gin.☆13Aug 31, 2020Updated 5 years ago
- esa client library for API v1 written in golang☆13Aug 15, 2019Updated 6 years ago
- dmmclust is a package for clustering short texts, based on Yin and Wang (2014)☆26Dec 13, 2017Updated 8 years ago
- A Golang library for text processing, including tokenization, part-of-speech tagging, and named-entity extraction.☆3,075May 2, 2023Updated 3 years ago
- permutation☆28Oct 14, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- CSS selector library in Go☆757Dec 19, 2024Updated last year
- Minimal cgo bindings for libenca☆19Mar 15, 2016Updated 10 years ago
- Package gorilla/css is a CSS3 tokenizer.☆90Nov 5, 2023Updated 2 years ago
- Chernyaev’s Marching Cubes 33 is one of the first algorithms intended to preserve the topology of the trilinear interpolant. In this work…☆14Jul 19, 2013Updated 12 years ago
- NIfTI support for Javascript☆14Mar 18, 2022Updated 4 years ago
- DICOM to NIfTI/BIDS validation script☆12May 1, 2025Updated last year
- Html Content / Article Extractor in Golang☆450Aug 3, 2025Updated 9 months ago