google / robotstxtLinks
The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
☆3,413Updated 10 months ago
Alternatives and similar repositories for robotstxt
Users that are interested in robotstxt are comparing it to the libraries listed below
Sorting:
- A Dead Simple VPN.☆5,225Updated 2 weeks ago
- Top-level domain name registry service on Google Cloud Platform☆1,742Updated this week
- A transparent, highly scalable and cryptographically verifiable data store.☆3,626Updated last week
- A document describing the HTTP/3 and QUIC protocols☆2,177Updated 10 months ago
- Microsoft Edge☆2,865Updated 10 months ago
- Scalable fuzzing infrastructure.☆5,408Updated this week
- Lucet, the Sandboxing WebAssembly Compiler.☆4,051Updated 3 years ago
- wwwBASIC is an implementation of BASIC that runs on Node.js and the Web.☆1,139Updated last year
- Itty.bitty is a tool to create links that contain small sites☆3,426Updated 2 years ago
- 📊 Analyze website stack from the terminal 💻☆1,998Updated 6 years ago
- Parsing, analyzing, and comparing source code across many languages☆9,040Updated 2 months ago
- Your Swiss Army Knife for Protocol Buffers☆5,046Updated 3 years ago
- "Don't code your UI, Draw it !"☆2,421Updated 5 years ago
- High-performance image manipulation for web servers. Includes imageflow_server, imageflow_tool, and libimageflow☆4,308Updated this week
- The Illustrated TLS 1.2 Connection: Every byte explained☆3,498Updated 5 months ago
- 🥧 Savoury implementation of the QUIC transport protocol and HTTP/3☆10,290Updated this week
- Virtual File System for Git: Enable Git at Enterprise Scale☆6,044Updated this week
- Memorable site for testing clients against bad SSL configs.☆2,938Updated last year
- FlameScope is a visualization tool for exploring different time ranges as Flame Graphs.☆3,070Updated last year
- Watches files and records, or triggers actions, when they change.☆13,110Updated this week
- Brad's homelab setup☆1,913Updated 5 years ago
- sso, aka S.S.Octopus, aka octoboi, is a single sign-on solution for securing internal services☆3,111Updated 2 months ago
- Binary Optimization and Layout Tool - A linux command-line utility used for optimizing performance of binaries☆2,532Updated 2 years ago
- C++14 implementation of the TLS-1.3 standard☆1,171Updated this week
- a FUSE file system based on Google Drive☆2,380Updated last year
- Wouldn't it be nice if `User-Agent` was a (set of) client hints?☆603Updated last month
- The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common…☆3,579Updated 3 weeks ago
- Easily and securely share files from the command line. A fully featured Firefox Send client.☆7,152Updated 4 months ago
- 🎮 GraphQL IDE for better development workflows (GraphQL Subscriptions, interactive docs & collaboration)☆8,824Updated last year
- ☆2,933Updated last year