Alternatives and similar repositories for robotstxt:

Users that are interested in robotstxt are comparing it to the libraries listed below

• google / clusterfuzz
  Scalable fuzzing infrastructure.
  ☆5,333Updated this week
• microsoft / BosqueLanguage
  The Bosque programming language is an experiment in regularized design for a machine assisted rapid and reliable software development lif…
  ☆5,250Updated 2 years ago
• coder / sshcode
  Run VS Code on any server over SSH.
  ☆5,731Updated 4 years ago
• jedisct1 / dsvpn
  A Dead Simple VPN.
  ☆5,183Updated 3 weeks ago
• karanchahal / DoodleMaster
  "Don't code your UI, Draw it !"
  ☆2,424Updated 5 years ago
• Netflix / pollyjs
  Record, Replay, and Stub HTTP Interactions.
  ☆10,219Updated last year
• google / pik
  A new lossy/lossless image format for photos and the internet
  ☆835Updated last year
• arfct / itty-bitty
  Itty.bitty is a tool to create links that contain small sites
  ☆3,410Updated last year
• bytecodealliance / lucet
  Lucet, the Sandboxing WebAssembly Compiler.
  ☆4,054Updated 2 years ago
• pomber / git-history
  Quickly browse the history of a file from any git repository
  ☆13,583Updated 3 months ago
• harababurel / gcsf
  a FUSE file system based on Google Drive
  ☆2,366Updated 7 months ago
• Netflix / titus
  ☆1,996Updated 2 years ago
• schollz / hostyoself
  Host yo' self from your browser, your phone, your toaster.
  ☆1,845Updated last year
• microsoft / VFSForGit
  Virtual File System for Git: Enable Git at Enterprise Scale
  ☆6,006Updated 3 weeks ago
• google / brotli
  Brotli compression format
  ☆13,726Updated this week
• bijection / sistine
  Turn a MacBook into a Touchscreen with $1 of Hardware
  ☆3,253Updated 4 years ago
• nbedos / termtosvg
  Record terminal sessions as SVG animations
  ☆9,717Updated 4 years ago
• trimstray / htrace.sh
  My simple Swiss Army knife for http/https troubleshooting and profiling.
  ☆3,771Updated last month
• google / guetzli
  Perceptual JPEG encoder
  ☆12,929Updated last year
• infostreams / db
  Version control for databases: save, restore, and archive snapshots of your database from the command line
  ☆1,304Updated 3 years ago
• google / brunsli
  Practical JPEG Repacker
  ☆740Updated 8 months ago
• microsoft / ProcMon-for-Linux
  A Linux version of the Procmon Sysinternals tool
  ☆4,082Updated 2 months ago
• rhysd / vim.wasm
  Vim editor ported to WebAssembly
  ☆5,561Updated 6 months ago
• simdjson / simdjson
  Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, …
  ☆19,580Updated this week
• github / glb-director
  GitHub Load Balancer Director and supporting tooling.
  ☆2,385Updated last week
• facebookarchive / LogDevice
  Distributed storage for sequential data
  ☆1,898Updated 3 years ago
• martenbjork / github-xp
  Give Github some XP flair 🔥
  ☆2,665Updated 5 years ago
• webhintio / hint
  💡 A hinting engine for the web
  ☆3,633Updated 2 months ago
• arasatasaygin / openlogos
  Free logos for open source projects
  ☆2,600Updated 6 years ago
• umpox / TinyEditor
  A functional HTML/CSS/JS editor in less than 400 bytes
  ☆2,340Updated last year