omrilotan / isbotLinks
π€/π¨βπ¦° Detect bots/crawlers/spiders using the user agent string
β1,040Updated this week
Alternatives and similar repositories for isbot
Users that are interested in isbot are comparing it to the libraries listed below
Sorting:
- Splits a hostname into subdomains, domain and (effective) top-level domains.β512Updated 5 months ago
- A JavaScript library for generating random user agents with data that's updated daily.β1,066Updated this week
- JavaScript Library to extract domains, subdomains and public suffixes from complex URIs.β643Updated this week
- NodeJS robots.txt parser with support for wildcard (*) matching.β156Updated 7 months ago
- Retry a promise-returning or async functionβ882Updated last month
- Bot detection library that runs in the browser. Detects automation tools and frameworks. No server required, runs 100% on the client. MITβ¦β1,238Updated last week
- β142Updated 4 months ago
- JavaScript domain name parser based on the Public Suffix Listβ414Updated 2 months ago
- A very fast HTML parser, generating a simplified DOM, with basic element query support.β1,182Updated 4 months ago
- Rate limit made simple, easy, async.β332Updated 2 months ago
- Map-like, concurrent promise processingβ813Updated last year
- Translate standard UUIDs into shorter formats and back.β496Updated 3 months ago
- The headless Chrome/Chromium driver on top of Puppeteer.β1,721Updated last month
- A cli to load dotenv filesβ543Updated last month
- HTTP client made for scraping based on got.β696Updated 2 months ago
- Sitemap-generating framework for node.jsβ1,615Updated 8 months ago
- Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcomeβ1,282Updated last month
- HTTP server cookie parsing and serializationβ1,411Updated 2 weeks ago
- Node.js API for GeoIP2 webservice client and database readerβ249Updated this week
- Normalize a URLβ847Updated 2 weeks ago
- Universal library for detecting devices based on the string `UserAgent`. We can identify: App, Bot, OS, Browser, Device brand, Device modβ¦β165Updated this week
- A precise user agent parser and device detector written in TypeScriptβ490Updated last year
- In-memory Node.js and browser job schedulerβ593Updated last month
- Node.js implementation of a proxy server (think Squid) with support for SSL, authentication and upstream proxy chaining.β918Updated 3 weeks ago
- Node.js module to generate URL slugs. Another one? This one cares about i18n and transliterates non-Latin scripts to conform to the RFC39β¦β591Updated 2 years ago
- The world's easiest, smallest and powerful visitor identifier for browsers.β491Updated last year
- π²Basic prettifier for Pino log linesβ1,435Updated this week
- Additional module to use with 'puppeteer' for setting proxies per page basis.β446Updated last year
- Official JavaScript port of Sqids. Generate short unique IDs from numbers.β787Updated 3 months ago
- An HTTP request client that provides an axios like interface over top of node-fetch. Super lightweight. Supports proxies and all sorts oβ¦β827Updated this week