google / robotstxtLinks
The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
☆3,416Updated last year
Alternatives and similar repositories for robotstxt
Users that are interested in robotstxt are comparing it to the libraries listed below
Sorting:
- ☆2,934Updated 2 years ago
- Parsing, analyzing, and comparing source code across many languages☆9,057Updated 4 months ago
- Virtual File System for Git: Enable Git at Enterprise Scale☆6,057Updated this week
- The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common…☆3,586Updated 2 weeks ago
- Run VS Code on any server over SSH.☆5,726Updated 5 years ago
- Deploy static websites in seconds - with HTTPS, a global CDN, and custom domains.☆1,741Updated 2 months ago
- Top-level domain name registry service on Google Cloud Platform☆1,755Updated this week
- HTTP-based JSON storage.☆2,491Updated 2 years ago
- Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, …☆21,050Updated this week
- Vim editor ported to WebAssembly☆5,600Updated 3 months ago
- A document describing the HTTP/3 and QUIC protocols☆2,183Updated last year
- Scalable fuzzing infrastructure.☆5,445Updated this week
- Open Location Code is a library to generate short codes, called "plus codes", that can be used as digital addresses where street addresse…☆4,231Updated last month
- 💡 A hinting engine for the web☆3,657Updated 9 months ago
- Your Swiss Army Knife for Protocol Buffers☆5,045Updated 3 years ago
- GitHub Repository Card for Any Web Site☆1,341Updated 4 years ago
- Free logos for open source projects☆2,596Updated 6 years ago
- Give Github some XP flair 🔥☆2,661Updated 6 years ago
- Run Lighthouse in CI, as a web service, using Docker. Pass/Fail GH pull requests.☆2,230Updated 5 years ago
- "Don't code your UI, Draw it !"☆2,422Updated 5 years ago
- A new lossy/lossless image format for photos and the internet☆833Updated 2 years ago
- nghttp2 - HTTP/2 C Library and tools☆4,833Updated this week
- GitHub Load Balancer Director and supporting tooling.☆2,411Updated this week
- Distributed storage for sequential data☆1,902Updated 3 years ago
- FlameScope is a visualization tool for exploring different time ranges as Flame Graphs.☆3,080Updated last year
- Brotli compression format☆14,235Updated this week
- Zopfli Compression Algorithm is a compression library programmed in C to perform very good, but slow, deflate or zlib compression.☆3,537Updated last year
- A history of edits to the US Constitution as it has been amended. Written in markdown to match original formatting.☆2,166Updated 4 years ago
- ✍️ Fusuma makes slides with Markdown easily.☆5,407Updated 8 months ago
- Automate Scrubbing your Facebook Presence☆2,675Updated 3 years ago