Alternatives and similar repositories for robotstxt

Users that are interested in robotstxt are comparing it to the libraries listed below

• dtinit / data-transfer-project
  The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common…
  ☆3,599Updated last week
• google / nomulus
  Top-level domain name registry service on Google Cloud Platform
  ☆1,766Updated this week
• bagder / http3-explained
  A document describing the HTTP/3 and QUIC protocols
  ☆2,213Updated last year
• taylorconor / quinesnake
  A quine that plays snake over its own source!
  ☆920Updated 6 years ago
• stewartmcgown / uds
  📀 Unlimited Google Drive Storage by splitting binary files into base64
  ☆4,368Updated 4 years ago
• github / semantic
  Parsing, analyzing, and comparing source code across many languages
  ☆9,061Updated 7 months ago
• cr-marcstevens / sha1collisiondetection
  Library and command line tool to detect SHA-1 collision in a file
  ☆1,379Updated last month
• martenbjork / github-xp
  Give Github some XP flair 🔥
  ☆2,658Updated 3 weeks ago
• cloudkj / scar
  Deploy static websites in seconds - with HTTPS, a global CDN, and custom domains.
  ☆1,743Updated 6 months ago
• WICG / webpackage
  Web packaging format
  ☆1,248Updated last week
• w3c / webappsec-change-password-url
  A Well-Known URL for Changing Passwords
  ☆905Updated 9 months ago
• kkuchta / css-only-chat
  A truly monstrous async web chat using no JS whatsoever on the frontend
  ☆6,599Updated 2 years ago
• weskerfoot / DeleteFB
  Automate Scrubbing your Facebook Presence
  ☆2,674Updated 3 years ago
• umpox / zero-width-detection
  Invisibly inserting usernames into text with Zero-Width Characters
  ☆1,174Updated 2 months ago
• simdjson / simdjson
  Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, …
  ☆22,772Updated last week
• rhysd / vim.wasm
  Vim editor ported to WebAssembly
  ☆5,609Updated last month
• diracdeltas / FastestWebsiteEver
  ultrafast single TCP packet audio/visual experience
  ☆1,402Updated last year
• Netflix / security-bulletins
  Security Bulletins that relate to Netflix Open Source
  ☆747Updated last year
• dropbox / lepton
  Lepton is a tool and file format for losslessly compressing JPEGs by an average of 22%.
  ☆5,009Updated last year
• instantpage / instant.page
  Make your site’s pages instant in 1 minute and improve your conversion rate by 1%
  ☆6,201Updated 10 months ago
• Netflix / titus
  ☆1,997Updated 3 years ago
• ecthros / uncaptcha2
  defeating the latest version of ReCaptcha with 91% accuracy
  ☆4,946Updated 6 years ago
• leeoniya / dropcss
  An exceptionally fast, thorough and tiny unused-CSS cleaner
  ☆2,136Updated 2 years ago
• vasanthv / jsonbox
  HTTP-based JSON storage.
  ☆2,488Updated 2 years ago
• google / pik
  A new lossy/lossless image format for photos and the internet
  ☆834Updated 2 years ago
• varnishcache / varnish-cache
  Varnish Cache source code repository
  ☆4,009Updated this week
• imazen / imageflow
  High-performance image manipulation for web servers. Includes imageflow_server, imageflow_tool, and libimageflow
  ☆4,344Updated last week
• nerdgeneration / www.sh
  Web framework in Bash
  ☆736Updated 5 years ago
• trimstray / htrace.sh
  My simple Swiss Army knife for http/https troubleshooting and profiling.
  ☆3,833Updated last year
• GoogleChrome / web-vitals-extension
  A Chrome extension to measure essential metrics for a healthy site
  ☆2,381Updated 9 months ago