omrilotan / isbot
π€/π¨βπ¦° Detect bots/crawlers/spiders using the user agent string
β1,016Updated 2 weeks ago
Alternatives and similar repositories for isbot:
Users that are interested in isbot are comparing it to the libraries listed below
- JavaScript Library to extract domains, subdomains and public suffixes from complex URIs.β625Updated this week
- Splits a hostname into subdomains, domain and (effective) top-level domains.β511Updated 3 months ago
- JavaScript domain name parser based on the Public Suffix Listβ406Updated 3 weeks ago
- Map-like, concurrent promise processingβ810Updated last year
- Retry a promise-returning or async functionβ860Updated this week
- NodeJS robots.txt parser with support for wildcard (*) matching.β154Updated 6 months ago
- Capture screenshots of websitesβ1,967Updated 5 months ago
- A precise user agent parser and device detector written in TypeScriptβ487Updated last year
- Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcomeβ1,272Updated last week
- Abstraction for exponential and custom retry strategies for failed operations.β1,248Updated last year
- HTTP server cookie parsing and serializationβ1,399Updated 2 months ago
- Retrying made simple, easy and asyncβ1,875Updated last year
- Sitemap-generating framework for node.jsβ1,605Updated 6 months ago
- RFC6265 Cookies and CookieJar for Node.jsβ1,001Updated last week
- Bot detection library that runs in the browser. Detects automation tools and frameworks. No server required, runs 100% on the client. MITβ¦β1,206Updated 2 months ago
- HTTP client made for scraping based on got.β671Updated last month
- Use Ky in both Node.js and browsersβ674Updated last year
- Get image size without full download. Supported image types: JPG, GIF, PNG, WebP, BMP, TIFF, SVG, PSD, ICO.β991Updated last year
- A JavaScript library for generating random user agents with data that's updated daily.β1,047Updated this week
- Simple argument parsingβ1,278Updated 9 months ago
- Google's libphonenumber pre-compiled with the closure compilerβ675Updated this week
- A cli to load dotenv filesβ537Updated 4 months ago
- Semaphore using `async` and `await`β640Updated last year
- Metadata scraper with support for oEmbed, Twitter Cards and Open Graph Protocol for Node.jsβ492Updated last year
- Get unified metadata from websites using Open Graph, Microdata, RDFa, Twitter Cards, JSON-LD, HTML, and more.β2,441Updated last week
- In-memory Node.js and browser job schedulerβ590Updated this week
- Throttle promise-returning & async functionsβ476Updated 5 months ago
- Convert milliseconds to a human readable string: `1337000000` β `15d 11h 23m 20s`β1,153Updated 5 months ago
- Simple and modern async event emitterβ1,936Updated 3 months ago
- Simple βLeast Recently Usedβ (LRU) cacheβ698Updated last month