Alternatives and similar repositories for robotstxt

Users that are interested in robotstxt are comparing it to the libraries listed below

• dtinit / data-transfer-project
  The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common…
  ☆3,580Updated last week
• google / zopfli
  Zopfli Compression Algorithm is a compression library programmed in C to perform very good, but slow, deflate or zlib compression.
  ☆3,530Updated 11 months ago
• google / gif-for-cli
  ☆2,932Updated last year
• anvaka / atree
  Just a simple Christmas tree, based on reddit story
  ☆2,486Updated 6 months ago
• google / clusterfuzz
  Scalable fuzzing infrastructure.
  ☆5,419Updated this week
• google / pik
  A new lossy/lossless image format for photos and the internet
  ☆832Updated 2 years ago
• MicrosoftEdge / MSEdge
  Microsoft Edge
  ☆2,867Updated 11 months ago
• mozilla / mozjpeg
  Improved JPEG encoder.
  ☆5,586Updated last month
• github / semantic
  Parsing, analyzing, and comparing source code across many languages
  ☆9,050Updated 3 months ago
• harababurel / gcsf
  a FUSE file system based on Google Drive
  ☆2,380Updated last year
• google / nomulus
  Top-level domain name registry service on Google Cloud Platform
  ☆1,749Updated this week
• imazen / imageflow
  High-performance image manipulation for web servers. Includes imageflow_server, imageflow_tool, and libimageflow
  ☆4,310Updated 3 weeks ago
• nerdgeneration / www.sh
  Web framework in Bash
  ☆734Updated 5 years ago
• mathieudutour / medium-to-own-blog
  Switch from Medium to your own blog in a few minutes
  ☆3,021Updated 2 years ago
• weskerfoot / DeleteFB
  Automate Scrubbing your Facebook Presence
  ☆2,675Updated 3 years ago
• google / ngx_brotli
  NGINX module for Brotli compression
  ☆2,170Updated last year
• tink-crypto / tink
  Tink is a multi-language, cross-platform, open source library that provides cryptographic APIs that are secure, easy to use correctly, an…
  ☆13,543Updated last year
• karanchahal / DoodleMaster
  "Don't code your UI, Draw it !"
  ☆2,422Updated 5 years ago
• vasanthv / jsonbox
  HTTP-based JSON storage.
  ☆2,492Updated 2 years ago
• rhysd / vim.wasm
  Vim editor ported to WebAssembly
  ☆5,600Updated 2 months ago
• google / sandboxed-api
  Generate sandboxes for C/C++ libraries automatically
  ☆1,708Updated this week
• coder / sshcode
  Run VS Code on any server over SSH.
  ☆5,726Updated 4 years ago
• google / wwwbasic
  wwwBASIC is an implementation of BASIC that runs on Node.js and the Web.
  ☆1,138Updated last year
• WICG / ua-client-hints
  Wouldn't it be nice if `User-Agent` was a (set of) client hints?
  ☆604Updated 2 months ago
• google / brunsli
  Practical JPEG Repacker
  ☆742Updated last year
• GoogleChrome / rendertron
  A Headless Chrome rendering solution
  ☆5,950Updated 2 years ago
• taylorconor / quinesnake
  A quine that plays snake over its own source!
  ☆921Updated 5 years ago
• GoogleChromeLabs / lighthousebot
  Run Lighthouse in CI, as a web service, using Docker. Pass/Fail GH pull requests.
  ☆2,230Updated 5 years ago
• cloudkj / scar
  Deploy static websites in seconds - with HTTPS, a global CDN, and custom domains.
  ☆1,740Updated 2 months ago
• facebookarchive / LogDevice
  Distributed storage for sequential data
  ☆1,904Updated 3 years ago