Alternatives and similar repositories for robotstxt

Users that are interested in robotstxt are comparing it to the libraries listed below

• bagder / http3-explained
  A document describing the HTTP/3 and QUIC protocols
  ☆2,188Updated last year
• dtinit / data-transfer-project
  The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common…
  ☆3,591Updated 2 weeks ago
• github / semantic
  Parsing, analyzing, and comparing source code across many languages
  ☆9,053Updated 5 months ago
• google / gif-for-cli
  ☆2,942Updated 2 years ago
• MicrosoftEdge / MSEdge
  Microsoft Edge
  ☆2,867Updated last year
• Netflix / titus
  ☆1,996Updated 3 years ago
• mathieudutour / medium-to-own-blog
  Switch from Medium to your own blog in a few minutes
  ☆3,019Updated 2 years ago
• w3c / webappsec-change-password-url
  A Well-Known URL for Changing Passwords
  ☆904Updated 7 months ago
• anvaka / atree
  Just a simple Christmas tree, based on reddit story
  ☆2,486Updated 8 months ago
• github / glb-director
  GitHub Load Balancer Director and supporting tooling.
  ☆2,411Updated last month
• google / pik
  A new lossy/lossless image format for photos and the internet
  ☆833Updated 2 years ago
• Netflix / flamescope
  FlameScope is a visualization tool for exploring different time ranges as Flame Graphs.
  ☆3,088Updated last year
• google / nomulus
  Top-level domain name registry service on Google Cloud Platform
  ☆1,759Updated this week
• google / clusterfuzz
  Scalable fuzzing infrastructure.
  ☆5,473Updated this week
• cloudkj / scar
  Deploy static websites in seconds - with HTTPS, a global CDN, and custom domains.
  ☆1,742Updated 4 months ago
• GoogleChromeLabs / lighthousebot
  Run Lighthouse in CI, as a web service, using Docker. Pass/Fail GH pull requests.
  ☆2,229Updated 5 years ago
• weskerfoot / DeleteFB
  Automate Scrubbing your Facebook Presence
  ☆2,676Updated 3 years ago
• google / brunsli
  Practical JPEG Repacker
  ☆744Updated last year
• JesseKPhillips / USA-Constitution
  A history of edits to the US Constitution as it has been amended. Written in markdown to match original formatting.
  ☆2,169Updated 4 years ago
• simdjson / simdjson
  Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, …
  ☆22,350Updated this week
• GoogleChrome / web-vitals-extension
  A Chrome extension to measure essential metrics for a healthy site
  ☆2,385Updated 7 months ago
• google / brotli
  Brotli compression format
  ☆14,301Updated this week
• nerdgeneration / www.sh
  Web framework in Bash
  ☆734Updated 5 years ago
• google / bottery
  ☆3,291Updated 6 years ago
• isacikgoz / gitin
  commit/branch/workdir explorer for git
  ☆1,872Updated 2 years ago
• sinclairzx81 / zero
  A 3D renderer written in JavaScript and rendered to the terminal.
  ☆2,432Updated 3 years ago
• google / trillian
  A transparent, highly scalable and cryptographically verifiable data store.
  ☆3,646Updated last week
• jstrieb / urlpages
  Create and view web pages stored entirely in the URL
  ☆1,380Updated 8 months ago
• google / zopfli
  Zopfli Compression Algorithm is a compression library programmed in C to perform very good, but slow, deflate or zlib compression.
  ☆3,549Updated last year
• google / open-location-code
  Open Location Code is a library to generate short codes, called "plus codes", that can be used as digital addresses where street addresse…
  ☆4,251Updated 3 months ago