A worker that will consume GOV.UK URLs from a message queue and crawl them, saving the output to disk
☆18Jul 31, 2023Updated 3 years ago
Alternatives and similar repositories for govuk_crawler_worker
Users that are interested in govuk_crawler_worker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tool to request, approve and create short URL redirects on GOV.UK☆14Updated this week
- [Deprecated] Styles, scripts and templates for building GOV.UK backend admin apps☆20Oct 21, 2026Updated last week
- mini wiki software in golang☆22Mar 15, 2026Updated 7 months ago
- memcached reimplementation in Go.☆16Aug 11, 2014Updated 12 years ago
- Managing redirects for sites moving to GOV.UK.☆14Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Publishes the Service Manual on GOV.UK☆12Updated this week
- CKAN extension for data.gov.uk☆12Oct 20, 2026Updated last week
- GOV.UK fork of Mapit, a web service to map postcodes to administrative boundaries☆12Oct 25, 2022Updated 4 years ago
- Manages uploaded assets (images, PDFs etc.) for applications on GOV.UK☆11Updated this week
- Create and manage needs on GOV.UK☆16Aug 7, 2025Updated last year
- File parsing and writing code for Ensembl☆10Oct 16, 2026Updated 2 weeks ago
- API to publish content on GOV.UK☆46Updated this week
- RuboCop style rules for GOV.UK's Ruby projects☆11Updated this week
- A collection of Rake tasks to manage DNS using Terraform☆15Apr 21, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- End to end tests for the Publishing pipeline of GOV.UK☆10Nov 3, 2022Updated 3 years ago
- ggit☆18Jul 8, 2013Updated 13 years ago
- Tirion is a complete infrastructure for monitoring applications during benchmarks☆19Mar 22, 2017Updated 9 years ago
- Summarizes text☆39Sep 16, 2015Updated 11 years ago
- Sends email alerts to the public for GOV.UK☆18Oct 23, 2026Updated last week
- Machine learning model to recommend related content☆18Oct 20, 2023Updated 3 years ago
- Code Examples for Effective MySQL Backup and Recovery Book☆12Jul 18, 2012Updated 14 years ago
- Serves contact pages on GOV.UK☆17Updated this week
- ☆10Jun 8, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A set of API adapters to work with the GOV.UK APIs☆22Updated this week
- ⚠️ Deprecated - Configures various linters to comply with GOV.UK's style guides☆15Nov 11, 2019Updated 6 years ago
- Create a coreos cluster from node.js☆12Dec 18, 2014Updated 11 years ago
- This repo contains the tech docs for data.gov.uk☆23Sep 10, 2026Updated last month
- Beta version of Find Data☆18Oct 22, 2026Updated last week
- Easy tools for traversing Go maps.☆19Nov 16, 2019Updated 6 years ago
- Code for The S3 Cookbook☆12May 10, 2009Updated 17 years ago
- An autocomplete multi-select component, built to be accessible.☆17Jul 7, 2025Updated last year
- Helm charts for the GOV.UK website and publishing platform (content management system). Cluster turnup automation is in https://github.co…☆24Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- HTTP router in front of GOV.UK to proxy to backend servers on a single domain.☆219Oct 22, 2026Updated last week
- Puppet module to manage graphite☆10Sep 27, 2011Updated 15 years ago
- Cookiecutter template for building consistent Terraform modules.☆12Nov 5, 2015Updated 10 years ago
- The code to run an Ensembl website☆22Sep 9, 2026Updated last month
- ☆17Sep 11, 2024Updated 2 years ago
- Matrix Factorization based recsys in Golang. Because facts are more important than ever☆35Feb 22, 2018Updated 8 years ago
- tablestruct creates mappings between Go structs and database tables.☆58Jul 29, 2014Updated 12 years ago