Kikobeats / top-crawler-agentsLinks
A list of common crawler user agents useful for retrieving metadata from links.
☆24Updated last week
Alternatives and similar repositories for top-crawler-agents
Users that are interested in top-crawler-agents are comparing it to the libraries listed below
Sorting:
- Use "cw" in the CLI. No instructions necessary, just hit <enter>. Can also be used as a library. Commit Whisperer is an AI genius for gen…☆19Updated 7 months ago
- Some useful utilities I often need☆35Updated 10 months ago
- Find a file or directory by walking up parent directories — Zero dependencies☆80Updated this week
- Easiest possible opinionated Babel AST printer☆19Updated last week
- Detects where the current browser extension code is being run. Chrome and Firefox.☆48Updated 4 months ago
- Get browser extension(webextension) item meta from Chrome Web Store and Firefox add-ons.☆31Updated 7 months ago
- High-level events and utilities for events in Web Extensions☆14Updated 4 months ago
- Your friendly neighborhood redirection service for Deno 🦕 to import code directly from GitHub.☆14Updated 3 years ago
- A library that helps you write tiny, fast, bundled and beautiful CLI apps that can automatically check for updates.☆25Updated 4 months ago
- A simple yet powerful opinionated tool for managing GitHub repositories.☆25Updated 11 months ago
- Execute a function right before the process is about to exit.☆14Updated 4 months ago
- Get a random temporary path☆32Updated last year
- Collection of useful utilities for working with Google Cloud Storage.☆14Updated 2 years ago
- Get all URLs in a text file or stdin☆46Updated 3 years ago
- Check if the process is running inside a container (Docker/Podman)☆74Updated last year
- A minimalistic wrapper around Node.js `child_process.spawn` API.☆30Updated last week
- Command-line interface for npmgraph☆9Updated last year
- Cloudflare Worker that generates RSS Feeds for web.dev☆12Updated last year
- 🤖 Script to automate creating built branches☆22Updated 2 years ago
- Utility functions for WebExtensions☆22Updated 4 months ago
- A Node.js module for looking up running processes☆12Updated 2 months ago
- Given any image (GIF, PNG, WebP, AVIF, etc) extract predominant & palette colors.☆114Updated last month
- Native fs for Javascript☆24Updated last year
- Extracts the repo URL from a package.json object☆25Updated last month
- Utility functions to inject content scripts from a WebExtension☆24Updated 2 months ago
- Adding compression (gzip/brotli) for your HTTP server in Node.js.☆53Updated 8 months ago
- Scaffolding for JavaScript☆10Updated 5 months ago
- Comparing the experience of using different testing libraries in javascript☆20Updated 3 months ago
- A curated collection of resources for learning to build Progressive Web Apps 💪☆32Updated 3 years ago
- ☆13Updated 2 months ago