google / robotstxtLinks
The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
☆3,417Updated last year
Alternatives and similar repositories for robotstxt
Users that are interested in robotstxt are comparing it to the libraries listed below
Sorting:
- Scalable fuzzing infrastructure.☆5,453Updated this week
- "Don't code your UI, Draw it !"☆2,419Updated 5 years ago
- Turn a MacBook into a Touchscreen with $1 of Hardware☆3,271Updated 4 years ago
- wwwBASIC is an implementation of BASIC that runs on Node.js and the Web.☆1,138Updated 2 years ago
- Make your site’s pages instant in 1 minute and improve your conversion rate by 1%☆6,170Updated 7 months ago
- ☆1,994Updated 3 years ago
- Record terminal sessions as SVG animations☆9,736Updated 5 years ago
- Just a simple Christmas tree, based on reddit story☆2,486Updated 8 months ago
- HTTP-based JSON storage.☆2,490Updated 2 years ago
- The Bosque programming language is an experiment in regularized design for a machine assisted rapid and reliable software development lif…☆5,237Updated 2 years ago
- NGINX module for Brotli compression☆2,185Updated last year
- Top-level domain name registry service on Google Cloud Platform☆1,757Updated this week
- The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common…☆3,587Updated this week
- ☆2,937Updated 2 years ago
- Automate Scrubbing your Facebook Presence☆2,676Updated 3 years ago
- Lucet, the Sandboxing WebAssembly Compiler.☆4,050Updated 3 years ago
- An experimental code editor for writing algorithms☆2,911Updated 6 years ago
- 💡 A hinting engine for the web☆3,655Updated 10 months ago
- Microsoft Edge☆2,865Updated last year
- A site to test the interaction of web APIs and browser permissions.☆1,204Updated last week
- 📀 Unlimited Google Drive Storage by splitting binary files into base64☆4,363Updated 3 years ago
- Host yo' self from your browser, your phone, your toaster.☆1,844Updated last year
- A document describing the HTTP/3 and QUIC protocols☆2,184Updated last year
- GitHub Load Balancer Director and supporting tooling.☆2,409Updated 3 weeks ago
- Deploy static websites in seconds - with HTTPS, a global CDN, and custom domains.☆1,742Updated 3 months ago
- a FUSE file system based on Google Drive☆2,378Updated last year
- Create and view web pages stored entirely in the URL☆1,378Updated 7 months ago
- Brad's homelab setup☆1,913Updated 5 years ago
- Web framework in Bash☆734Updated 5 years ago
- Quickly browse the history of a file from any git repository☆13,641Updated 10 months ago