DevDungeon / WebGenome

A breadth first web crawler that stores HTTP headers in a MongoDB database with a web front end all written in Go.
25Updated 6 years ago

Related projects

Alternatives and complementary repositories for WebGenome