google / robotstxtLinks
The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
☆3,442Updated last year
Alternatives and similar repositories for robotstxt
Users that are interested in robotstxt are comparing it to the libraries listed below
Sorting:
- Brotli compression format☆14,478Updated this week
- The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common…☆3,597Updated 3 weeks ago
- A document describing the HTTP/3 and QUIC protocols☆2,213Updated last year
- "Don't code your UI, Draw it !"☆2,416Updated 6 years ago
- Just a simple Christmas tree, based on reddit story☆2,490Updated 11 months ago
- Parsing, analyzing, and comparing source code across many languages☆9,059Updated 8 months ago
- Web framework in Bash☆736Updated 5 years ago
- Deploy static websites in seconds - with HTTPS, a global CDN, and custom domains.☆1,744Updated 6 months ago
- A truly monstrous async web chat using no JS whatsoever on the frontend☆6,600Updated 2 years ago
- Vim editor ported to WebAssembly☆5,610Updated last month
- Top-level domain name registry service on Google Cloud Platform☆1,769Updated this week
- GitHub Load Balancer Director and supporting tooling.☆2,417Updated 3 weeks ago
- Web packaging format☆1,249Updated last week
- Wouldn't it be nice if `User-Agent` was a (set of) client hints?☆613Updated last month
- Zopfli Compression Algorithm is a compression library programmed in C to perform very good, but slow, deflate or zlib compression.☆3,563Updated last year
- Record terminal sessions as SVG animations☆9,749Updated 5 years ago
- Scalable fuzzing infrastructure.☆5,497Updated last week
- A history of edits to the US Constitution as it has been amended. Written in markdown to match original formatting.☆2,170Updated 4 years ago
- ✍️ Fusuma makes slides with Markdown easily.☆5,392Updated last year
- 🔮 Libraries & tools for enabling Machine Learning driven user-experiences on the web☆7,101Updated last week
- Turn a MacBook into a Touchscreen with $1 of Hardware☆3,267Updated 5 years ago
- Give Github some XP flair 🔥☆2,658Updated last month
- a FUSE file system based on Google Drive☆2,376Updated last year
- Run Lighthouse in CI, as a web service, using Docker. Pass/Fail GH pull requests.☆2,226Updated 5 years ago
- A site to test the interaction of web APIs and browser permissions.☆1,222Updated last month
- An experimental code editor for writing algorithms☆2,906Updated 6 years ago