google / robotstxt
The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
☆3,410Updated 7 months ago
Alternatives and similar repositories for robotstxt:
Users that are interested in robotstxt are comparing it to the libraries listed below
- Parsing, analyzing, and comparing source code across many languages☆9,026Updated 8 months ago
- Switch from Medium to your own blog in a few minutes☆3,023Updated 2 years ago
- FlameScope is a visualization tool for exploring different time ranges as Flame Graphs.☆3,047Updated last year
- A Well-Known URL for Changing Passwords☆901Updated last month
- defeating the latest version of ReCaptcha with 91% accuracy☆4,952Updated 6 years ago
- A Chrome extension to measure essential metrics for a healthy site☆2,376Updated last month
- Web framework in Bash☆733Updated 4 years ago
- Give Github some XP flair 🔥☆2,662Updated 5 years ago
- Working copy of the HTTP/2 Specification☆3,724Updated 6 months ago
- An exceptionally fast, thorough and tiny unused-CSS cleaner☆2,134Updated last year
- Defeating Google's audio reCaptcha with 85% accuracy.☆2,805Updated 7 years ago
- A Dead Simple VPN.☆5,199Updated 2 weeks ago
- ChakraCore is an open source Javascript engine with a C API.☆9,166Updated last month
- Free, open-source SQL client for Windows and Mac 🦅☆5,125Updated last year
- 🕹️ A basic gameboy emulator with terminal "Cloud Gaming" support☆4,715Updated last year
- Deploy static websites in seconds - with HTTPS, a global CDN, and custom domains.☆1,741Updated 2 years ago
- ☆2,929Updated last year
- Version control for databases: save, restore, and archive snapshots of your database from the command line☆1,301Updated 3 years ago
- Generate sandboxes for C/C++ libraries automatically☆1,685Updated this week
- A quine that plays snake over its own source!☆919Updated 5 years ago
- HTTP-based JSON storage.☆2,490Updated 2 years ago
- commit/branch/workdir explorer for git☆1,866Updated 2 years ago
- GitHub Load Balancer Director and supporting tooling.☆2,395Updated last week
- FoundationDB - the open source, distributed, transactional key-value store☆15,025Updated this week
- Record terminal sessions as SVG animations☆9,719Updated 4 years ago
- Things you can do with a browser in 2020 ☕️☆8,034Updated 3 years ago
- wwwBASIC is an implementation of BASIC that runs on Node.js and the Web.☆1,136Updated last year
- GitHub Repository Card for Any Web Site☆1,339Updated 3 years ago
- P2P Docker registry capable of distributing TBs of data in seconds☆6,303Updated last week
- Make website screenshots and mobile emulations from the command line.☆1,671Updated 3 years ago