A worker that will consume GOV.UK URLs from a message queue and crawl them, saving the output to disk
☆18Jul 31, 2023Updated 3 years ago
Alternatives and similar repositories for govuk_crawler_worker
Users that are interested in govuk_crawler_worker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tool to request, approve and create short URL redirects on GOV.UK☆14Updated this week
- mini wiki software in golang☆22Mar 15, 2026Updated 8 months ago
- memcached reimplementation in Go.☆16Aug 11, 2014Updated 12 years ago
- Decommissioned: GOV.UK's Capistrano-based application deployment code. Replaced by alphagov/govuk-helm-charts.☆13Aug 24, 2023Updated 3 years ago
- Managing redirects for sites moving to GOV.UK.☆14Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Manages uploaded assets (images, PDFs etc.) for applications on GOV.UK☆11Updated this week
- CKAN extension for data.gov.uk☆12Nov 9, 2026Updated last week
- File parsing and writing code for Ensembl☆10Oct 16, 2026Updated last month
- GOV.UK fork of Mapit, a web service to map postcodes to administrative boundaries☆12Oct 25, 2022Updated 4 years ago
- A collection of Rake tasks to manage DNS using Terraform☆15Apr 21, 2023Updated 3 years ago
- API to publish content on GOV.UK☆46Updated this week
- End to end tests for the Publishing pipeline of GOV.UK☆10Nov 3, 2022Updated 4 years ago
- Tirion is a complete infrastructure for monitoring applications during benchmarks☆19Mar 22, 2017Updated 9 years ago
- ggit☆18Jul 8, 2013Updated 13 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- RuboCop style rules for GOV.UK's Ruby projects☆11Updated this week
- Summarizes text☆39Sep 16, 2015Updated 11 years ago
- Machine learning model to recommend related content☆18Oct 20, 2023Updated 3 years ago
- Serves contact pages on GOV.UK☆17Updated this week
- Configuration for GOV.UK's content delivery network☆17Sep 5, 2023Updated 3 years ago
- Search API for GOV.UK☆41Updated this week
- ☆10Jun 8, 2017Updated 9 years ago
- ⚠️ Deprecated - Configures various linters to comply with GOV.UK's style guides☆15Nov 11, 2019Updated 7 years ago
- Beta version of Find Data☆18Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- This repo contains the tech docs for data.gov.uk☆23Updated this week
- Create a coreos cluster from node.js☆12Dec 18, 2014Updated 11 years ago
- Code Examples for Effective MySQL Backup and Recovery Book☆12Jul 18, 2012Updated 14 years ago
- An example of how to use https://github.com/vikstrous/dataloadgen with gqlgen☆10Feb 3, 2024Updated 2 years ago
- A set of API adapters to work with the GOV.UK APIs☆24Updated this week
- An autocomplete multi-select component, built to be accessible.☆17Jul 7, 2025Updated last year
- r3conwhale aims to develop a multifunctional recon chain for web applications, intelligently interpreting collected data, and optimizing …☆14Jul 3, 2024Updated 2 years ago
- CloudFlare® command line tool and Go client☆13May 3, 2016Updated 10 years ago
- GNewsScraper is a TypeScript package that scrapes article data from Google News based on a keyword or phrase. It returns the results as a…☆15Aug 19, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Internal dashboard summarising the release pipeline for components of the GOV.UK web content management system.☆24Updated this week
- Cookiecutter template for building consistent Terraform modules.☆12Nov 5, 2015Updated 11 years ago
- Collection of operational focused osquery dashboards.☆10Jan 20, 2021Updated 5 years ago
- ☆10Apr 4, 2025Updated last year
- tablestruct creates mappings between Go structs and database tables.☆58Jul 29, 2014Updated 12 years ago
- Manages local links from local authorities on GOV.UK☆27Updated this week
- Terraform configuration to manage a Prometheus server running on AWS.☆23Jul 23, 2024Updated 2 years ago
Are these results useful?