The robots.txt exclusion protocol implementation for Go language
☆285Apr 1, 2026Updated last month
Alternatives and similar repositories for robotstxt
Users that are interested in robotstxt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- grobotstxt is a native Go port of Google's robots.txt parser and matcher library.☆115Mar 16, 2022Updated 4 years ago
- Go robots.txt parser☆15Nov 27, 2017Updated 8 years ago
- A simple and flexible web crawler that follows the robots.txt policies and crawl delays.☆791May 19, 2021Updated 4 years ago
- tiny Go library to normalize URLs☆485Mar 19, 2024Updated 2 years ago
- Polite, slim and concurrent web crawler.☆2,053May 19, 2021Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Mutation testing for Go☆27Mar 17, 2013Updated 13 years ago
- Better `go run`. Build go codes transparently and exec☆16Oct 14, 2018Updated 7 years ago
- Timeout invocation. Go porting of GNU timeout and able to use as Go package☆75Apr 21, 2019Updated 7 years ago
- Generate Go structs from JSON!☆42May 1, 2013Updated 13 years ago
- Loom - A repository for Weave Files☆26Jun 12, 2015Updated 10 years ago
- A little like that j-thing, only in Go.☆14,928Apr 11, 2026Updated 3 weeks ago
- ☆25Apr 30, 2015Updated 11 years ago
- gofind searches through Go source code by types.☆48Jul 13, 2023Updated 2 years ago
- A terminal clone of Don't Tap the White Tile, in Go☆11Feb 9, 2019Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- general tokenizer/scanner in Go☆42Sep 27, 2024Updated last year
- Go package to minify HTML (alpha-quality)☆15Mar 30, 2024Updated 2 years ago
- ASAP smoothing☆13Sep 8, 2017Updated 8 years ago
- Golang pkg for URL parsing and normalization☆162Jun 22, 2022Updated 3 years ago
- CGo wrapper package around the libtidy, the HTML tidy library☆22Nov 19, 2021Updated 4 years ago
- A webcomponent built with stencil to convert audio into text☆11Aug 24, 2018Updated 7 years ago
- Go library to run http servers on top of stripe's einhorn.☆10Oct 22, 2015Updated 10 years ago
- Defensive lemmatiser/stemmer written in Go ⊂( ⚆ ϖ⚆)っ☆14May 22, 2023Updated 2 years ago
- WebLoop: Scriptable, headless WebKit with a Go API. Like PhantomJS, but for Go.☆1,369Apr 1, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- (GitHub) Pkg Critic is a tool combining search results from GoDoc API and stats info from GitHub API.☆15Mar 14, 2016Updated 10 years ago
- A Go package concerning quoted-printable encoding.☆20Jul 16, 2015Updated 10 years ago
- Levenshtein String Distance☆12May 20, 2022Updated 3 years ago
- Hawk authentication implementation in Go☆75Nov 28, 2018Updated 7 years ago
- CORS middleware for Gin.☆13Aug 31, 2020Updated 5 years ago
- esa client library for API v1 written in golang☆13Aug 15, 2019Updated 6 years ago
- dmmclust is a package for clustering short texts, based on Yin and Wang (2014)☆26Dec 13, 2017Updated 8 years ago
- A Golang library for text processing, including tokenization, part-of-speech tagging, and named-entity extraction.☆3,074May 2, 2023Updated 3 years ago
- permutation☆28Oct 14, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Minimal cgo bindings for libenca☆19Mar 15, 2016Updated 10 years ago
- CSS selector library in Go☆757Dec 19, 2024Updated last year
- Chernyaev’s Marching Cubes 33 is one of the first algorithms intended to preserve the topology of the trilinear interpolant. In this work…☆14Jul 19, 2013Updated 12 years ago
- NIfTI support for Javascript☆14Mar 18, 2022Updated 4 years ago
- DICOM to NIfTI/BIDS validation script☆12May 1, 2025Updated last year
- Tools to help golang projects audit dependencies, check licenses, and create bill-of-materials☆16Jul 31, 2017Updated 8 years ago
- CGo bindings to Yandex.Mystem☆35Oct 5, 2016Updated 9 years ago