The Architecture of a Web Crawler: Building a Google-Inspired Distributed Web Crawler
☆126Dec 11, 2024Updated last year
Alternatives and similar repositories for distributed-web-crawler
Users that are interested in distributed-web-crawler are comparing it to the libraries listed below
Sorting:
- tfidf provides TF-IDF functionality☆13Nov 4, 2023Updated 2 years ago
- Go SDK for working with Cerbos☆15Updated this week
- (educational) build your own disk based KV store☆13Jul 27, 2024Updated last year
- Sanity client for Go.☆18Jul 5, 2025Updated 8 months ago
- Docker container to mount rclone remotes over FUSE☆12Aug 24, 2021Updated 4 years ago
- Airbnb scraper made in Go☆39Jul 10, 2025Updated 7 months ago
- Simple and easy to use authentication library for Golang☆40Feb 21, 2026Updated 2 weeks ago
- Dockerized headless Chromium☆17Mar 28, 2023Updated 2 years ago
- DomainsProject.org DNS worker☆26Aug 11, 2024Updated last year
- Go version updater.☆22Jun 20, 2025Updated 8 months ago
- An example backend with GoLang that uses auth0 for authentication☆18Jan 20, 2023Updated 3 years ago
- Generative Julia Set Image in Go☆19Feb 25, 2021Updated 5 years ago
- A minimal implementation of the fault-tolerant job scheduler.☆22Oct 9, 2022Updated 3 years ago
- Go library for parsing and submitting HTML forms☆19Nov 22, 2024Updated last year
- ☆20Jan 23, 2024Updated 2 years ago
- Lightweight JavaScript library to interact with Chromium-based browsers via the Chrome DevTools Protocol☆27May 12, 2024Updated last year
- DomainsProject.org HTTP worker☆25Dec 11, 2022Updated 3 years ago
- A decentralized poker game engine written in Golang and Solidity☆88Jan 27, 2024Updated 2 years ago
- Digital Pali Reader☆26Mar 2, 2020Updated 6 years ago
- Draw on an HTML 2D canvas in a web browser from a server program using WebSockets.☆94Dec 21, 2025Updated 2 months ago
- 🌍🚀 Effortlessly simple i18n for Go. Plurals, gender, and more made easy!☆97Nov 19, 2023Updated 2 years ago
- Procedural generation of geometric patterns and fractals.☆23Oct 20, 2021Updated 4 years ago
- Go, gRPC, microservices, docker example☆23Mar 13, 2023Updated 2 years ago
- 27.6% of the Top 10 Million Sites are Dead☆116Nov 4, 2024Updated last year
- ☆27Jan 29, 2022Updated 4 years ago
- A library for testing responses of HTTP requests☆12Feb 11, 2022Updated 4 years ago
- xirho is a simple generalized iterated function system plotter.☆27Oct 13, 2023Updated 2 years ago
- Minimal rules engine, uses yaml as input☆27Mar 13, 2024Updated last year
- Creates new projects from parameterized templates☆28May 27, 2020Updated 5 years ago
- Package astar implements the A* search algorithm for finding least-cost paths.☆31Aug 14, 2024Updated last year
- cdp-proxy is a mitm style HTTP proxy and middleware leveraging Chrome DevTools for UI, written in Go.☆35May 5, 2023Updated 2 years ago
- Experimental tagging schema for analysis of intersectionality, bias, and reception theories.☆11Feb 21, 2024Updated 2 years ago
- Creative and educational project for distributed system☆20Mar 10, 2021Updated 4 years ago
- ☆31Nov 25, 2023Updated 2 years ago
- A fast URL parser for Go☆40Mar 4, 2023Updated 3 years ago
- The Golsp programming language.☆32Feb 13, 2019Updated 7 years ago
- build and animate objects according to verlet physics. pure golang library☆31Aug 7, 2022Updated 3 years ago
- YouTube client on your terminal☆31Jul 28, 2022Updated 3 years ago
- draw images in terminals☆86Feb 6, 2026Updated last month