Alternatives and similar repositories for robotstxt:

Users that are interested in robotstxt are comparing it to the libraries listed below

• bagder / http3-explained
  A document describing the HTTP/3 and QUIC protocols
  ☆2,160Updated 6 months ago
• google / zopfli
  Zopfli Compression Algorithm is a compression library programmed in C to perform very good, but slow, deflate or zlib compression.
  ☆3,482Updated 6 months ago
• cloudkj / scar
  Deploy static websites in seconds - with HTTPS, a global CDN, and custom domains.
  ☆1,738Updated 2 years ago
• vasanthv / jsonbox
  HTTP-based JSON storage.
  ☆2,492Updated 2 years ago
• github / semantic
  Parsing, analyzing, and comparing source code across many languages
  ☆9,012Updated 6 months ago
• google / ngx_brotli
  NGINX module for Brotli compression
  ☆2,116Updated 8 months ago
• GoogleChrome / rendertron
  A Headless Chrome rendering solution
  ☆5,942Updated 2 years ago
• synox / youtube-dl-interactive
  OBSOLETE - Interactively select the quality and format for youtube-dl
  ☆1,444Updated 4 years ago
• facebookarchive / BOLT
  Binary Optimization and Layout Tool - A linux command-line utility used for optimizing performance of binaries
  ☆2,527Updated last year
• google / brotli
  Brotli compression format
  ☆13,857Updated 2 weeks ago
• yujiosaka / headless-chrome-crawler
  Distributed crawler powered by Headless Chrome
  ☆5,549Updated last year
• eashish93 / imgsquash
  Simple image compression full website code written in node, react and next.js framework. Easy to deploy as a microservice.
  ☆950Updated 4 years ago
• jemalloc / jemalloc
  ☆9,768Updated this week
• HFO4 / gameboy.live
  🕹️ A basic gameboy emulator with terminal "Cloud Gaming" support
  ☆4,706Updated last year
• mathieudutour / medium-to-own-blog
  Switch from Medium to your own blog in a few minutes
  ☆3,027Updated last year
• facebookincubator / fizz
  C++14 implementation of the TLS-1.3 standard
  ☆1,151Updated this week
• google / pik
  A new lossy/lossless image format for photos and the internet
  ☆836Updated last year
• martenbjork / github-xp
  Give Github some XP flair 🔥
  ☆2,664Updated 5 years ago
• GoogleChrome / web-vitals-extension
  A Chrome extension to measure essential metrics for a healthy site
  ☆2,373Updated 2 weeks ago
• lovasoa / bad_json_parsers
  Exposing problems in json parsers of several programming languages.
  ☆365Updated 2 years ago
• OpenDiablo2 / OpenDiablo2
  An open source re-implementation of Diablo 2
  ☆10,811Updated 3 years ago
• apple / foundationdb
  FoundationDB - the open source, distributed, transactional key-value store
  ☆14,818Updated this week
• dtinit / data-transfer-project
  The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common…
  ☆3,577Updated 2 weeks ago
• bagder / http2-explained
  A detailed document explaining and documenting HTTP/2, the successor to the widely popular HTTP/1.1 protocol
  ☆2,276Updated 10 months ago
• GoogleChromeLabs / lighthousebot
  Run Lighthouse in CI, as a web service, using Docker. Pass/Fail GH pull requests.
  ☆2,231Updated 4 years ago
• Netflix / pollyjs
  Record, Replay, and Stub HTTP Interactions.
  ☆10,224Updated last year
• github / glb-director
  GitHub Load Balancer Director and supporting tooling.
  ☆2,388Updated 3 weeks ago
• google / eng-practices
  Google's Engineering Practices documentation
  ☆20,097Updated 5 months ago
• nbedos / termtosvg
  Record terminal sessions as SVG animations
  ☆9,718Updated 4 years ago
• syncsynchalt / illustrated-tls12
  The Illustrated TLS 1.2 Connection: Every byte explained
  ☆3,475Updated last month