google / robotstxtLinks
The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
☆3,424Updated last year
Alternatives and similar repositories for robotstxt
Users that are interested in robotstxt are comparing it to the libraries listed below
Sorting:
- ☆2,941Updated 2 years ago
- Just a simple Christmas tree, based on reddit story☆2,484Updated 9 months ago
- The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common…☆3,592Updated last month
- "Don't code your UI, Draw it !"☆2,419Updated 5 years ago
- GitHub Load Balancer Director and supporting tooling.☆2,413Updated last week
- A document describing the HTTP/3 and QUIC protocols☆2,188Updated last year
- Microsoft Edge☆2,864Updated last year
- ☆1,995Updated 3 years ago
- Wouldn't it be nice if `User-Agent` was a (set of) client hints?☆607Updated 5 months ago
- FlameScope is a visualization tool for exploring different time ranges as Flame Graphs.☆3,091Updated 2 years ago
- Give Github some XP flair 🔥☆2,659Updated 6 years ago
- A Well-Known URL for Changing Passwords☆904Updated 8 months ago
- A new lossy/lossless image format for photos and the internet☆833Updated 2 years ago
- My dad's resume and skills from 1980☆1,738Updated 7 years ago
- A lightning fast Finite State machine and REgular expression manipulation library.☆1,861Updated 10 months ago
- Fast open source Slack desktop app☆1,665Updated 3 years ago
- Exposing problems in json parsers of several programming languages.☆370Updated 2 years ago
- Free logos for open source projects☆2,597Updated 7 years ago
- Distributed storage for sequential data☆1,902Updated 4 years ago
- Web framework in Bash☆735Updated 5 years ago
- 🕹️ A basic gameboy emulator with terminal "Cloud Gaming" support☆4,814Updated 6 months ago
- wwwBASIC is an implementation of BASIC that runs on Node.js and the Web.☆1,140Updated 2 years ago
- Parsing, analyzing, and comparing source code across many languages☆9,060Updated 6 months ago
- Top-level domain name registry service on Google Cloud Platform☆1,762Updated this week
- ☆1,477Updated 3 weeks ago
- Zopfli Compression Algorithm is a compression library programmed in C to perform very good, but slow, deflate or zlib compression.☆3,553Updated last year
- Deploy static websites in seconds - with HTTPS, a global CDN, and custom domains.☆1,742Updated 4 months ago
- My simple Swiss Army knife for http/https troubleshooting and profiling.☆3,827Updated 10 months ago
- HTTP-based JSON storage.☆2,488Updated 2 years ago
- Library and command line tool to detect SHA-1 collision in a file☆1,368Updated last year