google / robotstxt
The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
☆3,393Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for robotstxt
- A document describing the HTTP/3 and QUIC protocols☆2,151Updated 3 months ago
- Original Windows File Manager (winfile) with enhancements☆6,857Updated 4 months ago
- ☆2,924Updated last year
- Parsing, analyzing, and comparing source code across many languages☆8,977Updated 3 months ago
- Vim editor ported to WebAssembly☆5,512Updated 4 months ago
- Record terminal sessions as SVG animations☆9,712Updated 4 years ago
- Generate sandboxes for C/C++ libraries automatically☆1,667Updated this week
- The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common…☆3,572Updated this week
- A distributed approximate nearest neighborhood search (ANN) library which provides a high quality vector index build, search and distribu…☆4,829Updated 2 months ago
- Code AI platform with Code Search & Cody☆10,117Updated 2 months ago
- a FUSE file system based on Google Drive☆2,357Updated 5 months ago
- A standalone version of the readability lib☆9,018Updated last month
- A high performance HTTP proxy cache server and RESTful NoSQL cache server based on HAProxy☆1,910Updated 2 years ago
- Tink is a multi-language, cross-platform, open source library that provides cryptographic APIs that are secure, easy to use correctly, an…☆13,503Updated 7 months ago
- Scalable fuzzing infrastructure.☆5,308Updated this week
- A command-line tool to turn web pages into readable PDF, EPUB, HTML, or Markdown docs.☆4,319Updated 2 weeks ago
- Switch from Medium to your own blog in a few minutes☆3,029Updated last year
- A Headless Chrome rendering solution☆5,939Updated 2 years ago
- GitHub Load Balancer Director and supporting tooling.☆2,378Updated 4 months ago
- Brotli compression format☆13,598Updated this week
- Microsoft Edge☆2,835Updated 3 months ago
- A short description of the C++ build process☆1,209Updated 3 months ago
- My simple Swiss Army knife for http/https troubleshooting and profiling.☆3,760Updated this week
- Ethr is a Comprehensive Network Measurement Tool for TCP, UDP & ICMP.☆5,792Updated last year
- An experimental code editor for writing algorithms☆2,915Updated 5 years ago
- Your Swiss Army Knife for Protocol Buffers☆5,042Updated 2 years ago
- The Public Suffix List☆2,079Updated this week
- Quickly browse the history of a file from any git repository☆13,565Updated last month
- Zero is a web server to simplify web development.☆5,834Updated 8 months ago