google / robotstxt
The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
☆3,390Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for robotstxt
- Virtual File System for Git: Enable Git at Enterprise Scale☆5,983Updated last week
- Jsonnet - The data templating language☆6,981Updated 2 months ago
- ☆2,925Updated last year
- A Headless Chrome rendering solution☆5,935Updated 2 years ago
- Parsing, analyzing, and comparing source code across many languages☆8,966Updated 3 months ago
- The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common…☆3,572Updated this week
- A truly monstrous async web chat using no JS whatsoever on the frontend☆6,584Updated last year
- Scalable fuzzing infrastructure.☆5,297Updated this week
- A document describing the HTTP/3 and QUIC protocols☆2,151Updated 3 months ago
- Upspin: A framework for naming everyone's everything.☆6,282Updated 3 months ago
- Declarative web scraping☆5,737Updated this week
- Working copy of the HTTP/2 Specification☆3,721Updated 2 months ago
- Fast persistent recoverable log and key-value store + cache, in C# and C++.☆6,318Updated last week
- High performance, maintainable stylesheets.☆6,332Updated last year
- Zopfli Compression Algorithm is a compression library programmed in C to perform very good, but slow, deflate or zlib compression.☆3,428Updated 2 months ago
- Record, Replay, and Stub HTTP Interactions.☆10,215Updated last year
- Chrome extension that records your browser interactions and generates a Playwright or Puppeteer script.☆15,035Updated last year
- RE2 is a fast, safe, thread-friendly alternative to backtracking regular expression engines like those used in PCRE, Perl, and Python. It…☆8,965Updated 2 weeks ago
- Solid - Re-decentralizing the web (project directory)☆8,161Updated 2 years ago
- Fast trigram based code search☆1,701Updated 9 months ago
- A lightning fast Finite State machine and REgular expression manipulation library.☆1,832Updated last year
- Perkeep (née Camlistore) is your personal storage system for life: a way of storing, syncing, sharing, modelling and backing up content.☆6,485Updated 6 months ago
- GitHub Repository Card for Any Web Site☆1,330Updated 3 years ago
- Lucet, the Sandboxing WebAssembly Compiler.☆4,063Updated 2 years ago
- Simple image compression full website code written in node, react and next.js framework. Easy to deploy as a microservice.☆950Updated 4 years ago
- Tom's Obvious, Minimal Language☆19,535Updated last month
- High-performance image manipulation for web servers. Includes imageflow_server, imageflow_tool, and libimageflow☆4,179Updated last week
- Wrangling Untrusted File Formats Safely☆4,177Updated this week
- SQL interface to git repositories, written in Go. https://docs.sourced.tech/gitbase☆2,065Updated last year