Alternatives and similar repositories for robots-parser:

Users that are interested in robots-parser are comparing it to the libraries listed below

• szmarczak / cacheable-lookup
  A cacheable dns.lookup(…) that respects TTL
  ☆197Updated last year
• joeattardi / json-colorizer
  A library for colorizing JSON strings
  ☆85Updated 9 months ago
• peerigon / parse-domain
  Splits a hostname into subdomains, domain and (effective) top-level domains.
  ☆510Updated 3 weeks ago
• ekalinin / robots.js
  Parser for robots.txt for node.js
  ☆67Updated 3 years ago
• rgrove / parse-xml
  A fast, safe, compliant XML parser for Node.js and browsers.
  ☆305Updated 3 months ago
• avoidwork / tiny-lru
  Tiny LRU cache for Client or Server
  ☆159Updated this week
• lovell / highwayhash
  Node.js implementation of HighwayHash, Google's fast and strong hash function
  ☆219Updated 3 years ago
• forwardemail / nodejs-dns-over-https-tangerine
  Node.js DNS over HTTPS - Tangerine is the best drop-in replacement for dns.promises.Resolver using DNS over HTTPS ("DoH") via undici wit…
  ☆156Updated last month
• sindresorhus / get-stream
  Get a stream as a string, Buffer, ArrayBuffer or array
  ☆345Updated 3 months ago
• aduth / memize
  Unabashedly-barebones memoization library with an aim toward speed
  ☆119Updated last year
• davidmarkclements / fast-safe-stringify
  Safely and quickly serialize JavaScript objects
  ☆347Updated last month
• codsen / codsen
  a monorepo of npm packages
  ☆193Updated 3 weeks ago
• sapics / geoip-country
  Less memory usage version of geoip-lite by supporting only country lookup.
  ☆90Updated this week
• dachev / node-cld
  Language detection for Javascript (Node). Based on the CLD2 (Compact Language Detector) library from Google.
  ☆321Updated 5 months ago
• devongovett / exif-reader
  A small EXIF image metadata reader
  ☆157Updated last month
• brycebaril / node-stats-lite
  A light statistical package that operates on Arrays.
  ☆74Updated 4 years ago
• sindresorhus / is-svg
  Check if a string or buffer is SVG
  ☆133Updated 6 months ago
• mykolaharmash / hyntax
  Straightforward HTML parser for JavaScript
  ☆139Updated 7 months ago
• sindresorhus / srcset
  Parse and stringify the HTML <img> srcset attribute
  ☆138Updated last year
• mcollina / fastparallel
  Zero-overhead parallel function call for node.js. Also supports each and map!
  ☆163Updated 2 years ago
• ndjson / ndjson.js
  Streaming line delimited json parser + serializer
  ☆113Updated 3 years ago
• FGRibreau / node-language-detect
  🇫🇷 NodeJS language detection library using n-gram
  ☆400Updated 4 years ago
• mcollina / on-exit-leak-free
  Execute a function on exit without leaking memory, allowing all objects to be garbage collected
  ☆144Updated 9 months ago
• opentable / accept-language-parser
  It parses the accept-language header from an HTTP request
  ☆164Updated 3 years ago
• grantila / fetch-h2
  HTTP/1+2 Fetch API client for Node.js
  ☆335Updated last year
• delvedor / hpagent
  A ready to use http and https agent for working with proxies that keeps connections alive!
  ☆184Updated last year
• philcockfield / file-system-cache
  A super-fast, promise based cache that reads and writes to the file-system.
  ☆62Updated 6 months ago
• fastify / fastify-compress
  Fastify compression utils
  ☆206Updated last week
• perezd / node-murmurhash
  A Node.js module for the optimized JavaScript implementation of the MurmurHash algorithms.
  ☆95Updated last year
• sindresorhus / p-all
  Run promise-returning & async functions concurrently with optional limited concurrency
  ☆325Updated last month