The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
☆3,478Apr 1, 2026Updated 7 months ago
Alternatives and similar repositories for robotstxt
Users that are interested in robotstxt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Parsing, analyzing, and comparing source code across many languages☆9,042Apr 1, 2025Updated last year
- Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, …☆24,591Updated this week
- FoundationDB - the open source, distributed, transactional key-value store☆16,869Updated this week
- Zstandard - Fast real-time compression algorithm☆28,281Updated this week
- Diem’s mission is to build a trusted and innovative financial network that empowers people and businesses around the world.☆16,658Nov 13, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- JavaScript API for Chrome and Firefox☆95,878Updated this week
- A modern editor with a backend written in Rust.☆19,794Mar 19, 2024Updated 2 years ago
- Automated auditing, performance metrics, and best practices for the web.☆31,179Updated this week
- Brotli compression format☆15,128Updated this week
- 🦔 Fast, lightweight & schema-less search backend. An alternative to Elasticsearch that runs on a few MBs of RAM.☆21,389Nov 10, 2026Updated last week
- Lucet, the Sandboxing WebAssembly Compiler.☆4,037Mar 23, 2022Updated 4 years ago
- Secure and fast microVMs for serverless computing.☆38,154Updated this week
- Scalable fuzzing infrastructure.☆5,638Updated this week
- Code AI platform with Code Search & Cody☆10,278Sep 2, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Windows Calculator: A simple yet powerful calculator that ships with Windows☆31,097Oct 23, 2026Updated 3 weeks ago
- Simple, private file sharing from the makers of Firefox☆13,236May 21, 2021Updated 5 years ago
- Application Kernel for Containers☆20,071Updated this week
- Tink is a multi-language, cross-platform, open source library that provides cryptographic APIs that are secure, easy to use correctly, an…☆13,531Apr 17, 2024Updated 2 years ago
- The original sources of MS-DOS 1.25, 2.0, and 4.0 for reference purposes☆32,254Apr 25, 2024Updated 2 years ago
- A command line tool and library for transferring data with URL syntax, supporting DICT, FILE, FTP, FTPS, GOPHER, GOPHERS, HTTP, HTTPS, IM…☆43,624Updated this week
- For empowering community 🌱☆22,844Updated this week
- Servo aims to empower developers with a lightweight, high-performance alternative for embedding web technologies in applications.☆38,578Updated this week
- A command-line tool that makes git easier to use with GitHub.☆22,956Feb 2, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Fast and extensible multi-platform HTTP/1-2-3 web server with automatic HTTPS☆79,359Updated this week
- A terminal built on web technologies☆44,745Nov 4, 2026Updated 2 weeks ago
- SQL powered operating system instrumentation, monitoring, and analytics.☆23,788Updated this week
- A simple zero-config tool to make locally trusted development certificates with any names you'd like.☆59,891Aug 13, 2024Updated 2 years ago
- A Headless Chrome rendering solution☆5,948Oct 6, 2022Updated 4 years ago
- The Big List of Naughty Strings is a list of strings which have a high probability of causing issues when used as user-input data.☆47,720Apr 18, 2024Updated 2 years ago
- a fast, scalable, multi-language and extensible build system☆26,130Updated this week
- A fully-modern text-based browser, rendering to TTY and browsers☆19,135Nov 2, 2026Updated 2 weeks ago
- A JavaScript engine optimized for running React Native.☆11,448Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A modern runtime for JavaScript and TypeScript.☆109,120Updated this week
- Web rendering surface for Node applications☆9,237Apr 29, 2022Updated 4 years ago
- Your self-hosted, globally interconnected microblogging community☆50,607Updated this week
- Simple, fast, safe, compiled language for developing maintainable software. Compiles itself in <1s with zero library dependencies. Suppor…☆38,120Updated this week
- ShellCheck, a static analysis tool for shell scripts☆40,362Updated this week
- A tool for exploring each layer in a docker image☆54,752Updated this week
- The 1.x line is frozen - features and bugfixes now happen on https://github.com/yarnpkg/berry☆41,458May 12, 2026Updated 6 months ago
Are these results useful?