Alternatives and similar repositories for robots-parser:

Users that are interested in robots-parser are comparing it to the libraries listed below

• peerigon / parse-domain
  Splits a hostname into subdomains, domain and (effective) top-level domains.
  ☆511Updated last month
• szmarczak / cacheable-lookup
  A cacheable dns.lookup(…) that respects TTL
  ☆199Updated last year
• sindresorhus / p-all
  Run promise-returning & async functions concurrently with optional limited concurrency
  ☆326Updated 3 months ago
• avoidwork / tiny-lru
  Tiny LRU cache for Client or Server
  ☆159Updated this week
• sindresorhus / get-stream
  Get a stream as a string, Buffer, ArrayBuffer or array
  ☆345Updated 4 months ago
• sindresorhus / into-stream
  Convert a string/promise/array/iterable/asynciterable/buffer/typedarray/arraybuffer/object into a stream
  ☆206Updated last year
• ekalinin / robots.js
  Parser for robots.txt for node.js
  ☆67Updated 3 years ago
• joeattardi / json-colorizer
  A library for colorizing JSON strings
  ☆85Updated 10 months ago
• opentable / accept-language-parser
  It parses the accept-language header from an HTTP request
  ☆165Updated 3 years ago
• microlinkhq / async-ratelimiter
  Rate limit made simple, easy, async.
  ☆323Updated 10 months ago
• sindresorhus / p-wait-for
  Wait for a condition to be true
  ☆158Updated last year
• fent / timequeue.js
  A queue with custom concurrency and time limit.
  ☆196Updated 2 years ago
• forwardemail / nodejs-dns-over-https-tangerine
  Node.js DNS over HTTPS - Tangerine is the best drop-in replacement for dns.promises.Resolver using DNS over HTTPS ("DoH") via undici wit…
  ☆162Updated 3 months ago
• philcockfield / file-system-cache
  A super-fast, promise based cache that reads and writes to the file-system.
  ☆63Updated 7 months ago
• runk / node-chardet
  Character encoding detection tool for NodeJS
  ☆285Updated 3 weeks ago
• sindresorhus / get-urls
  Get all urls in a string
  ☆367Updated last year
• morteza-fsh / puppeteer-full-page-screenshot
  ☆89Updated last month
• perezd / node-murmurhash
  A Node.js module for the optimized JavaScript implementation of the MurmurHash algorithms.
  ☆96Updated last year
• 75lb / wordwrapjs
  Word-wrapping for javascript.
  ☆161Updated 4 months ago
• fb55 / entities
  encode & decode HTML & XML entities with ease & speed
  ☆332Updated this week
• devongovett / exif-reader
  A small EXIF image metadata reader
  ☆159Updated 2 months ago
• fergiemcdowall / stopword
  A module for node.js and the browser that takes in text and strips it of stopwords
  ☆244Updated 2 months ago
• taskcluster / slugid
  URL-safe base64 UUID encoder for generating 22 character slugs
  ☆92Updated 2 months ago
• AndreasMadsen / htmlparser-benchmark
  Simple benchmark for diffrent htmlparsers using real-life data
  ☆102Updated last month
• P4sca1 / cron-schedule
  A zero-dependency cron parser and scheduler for Node.js, Deno and the browser.
  ☆188Updated last week
• cabinjs / axe
  Logger-agnostic wrapper that normalizes logs regardless of arg style. Great for large dev teams, old/new projects, and works w/Pino, Bun…
  ☆50Updated 3 months ago
• lukeed / nestie
  A tiny (215B) and fast utility to expand a flattened object
  ☆202Updated last year
• fastify / fastify-reply-from
  fastify plugin to forward the current http request to another server
  ☆154Updated last week
• gajus / http-terminator
  Gracefully terminates HTTP(S) server.
  ☆327Updated last year
• haraka / node-address-rfc2822
  Parser for RFC2822 (Header) format email addresses
  ☆54Updated 2 months ago