Kikobeats / top-crawler-agentsView external linksLinks
A list of common crawler user agents useful for retrieving metadata from links.
☆28Updated this week
Alternatives and similar repositories for top-crawler-agents
Users that are interested in top-crawler-agents are comparing it to the libraries listed below
Sorting:
- Setup TLS details according to `user-agent` respecting browser specific preferences.☆15Dec 30, 2025Updated last month
- Python assorted code: small experiments, scripts and snippets☆17Dec 19, 2025Updated last month
- Run official FLAC tools "flac" and "metaflac" as WebAssembly, on browsers or Deno.☆18Nov 29, 2024Updated last year
- ☆26Jan 24, 2026Updated 3 weeks ago
- ☆26Apr 28, 2025Updated 9 months ago
- ☆15Sep 21, 2019Updated 6 years ago
- Fastest, plain JavaScript-based, regexp escaping library for JavaScript, works in both Node.js and browser.☆46Sep 18, 2025Updated 4 months ago
- TypeScript incomplete guide.☆31Jul 2, 2023Updated 2 years ago
- 2nd place project (Modern Ads) of the ICT9 challenge competition. Backend micro service.☆10Sep 21, 2024Updated last year
- Sticky notes Mac app for simple task management☆13Jan 18, 2026Updated 3 weeks ago
- trivial app for Macs to show volume in menu bar even when using headphones☆10Feb 5, 2025Updated last year
- An open-source SVGs icon library☆11Jul 15, 2025Updated 7 months ago
- Analyzes target website for anti-scraping protections and performance. Saves screenshots/HTML snapshots.☆11Aug 13, 2025Updated 6 months ago
- Creates NSCursors with 2/3/4-pronged resize cursors, possibly rounded and rotated☆16Feb 15, 2017Updated 8 years ago
- A curated list of best ai tools☆30Aug 20, 2025Updated 5 months ago
- Track the origin of your json values for better error reporting!☆16Oct 10, 2020Updated 5 years ago
- ICU-WP is a Flask-based WordPress username enumeration tool. It detects WordPress sites and uses methods like author URL checks, REST API…☆14Jan 17, 2025Updated last year
- Python-based high-performance web tools - see http://chris.improbable.org/2010/01/30/quickly-testing-your-sites-using-webtoolbox/ for an …☆21Oct 24, 2017Updated 8 years ago
- An open tvOS, iOS and macOS app to play free and publicly available classic movies from Internet Archive☆10Oct 30, 2022Updated 3 years ago
- Fortune cookie app for Flipper Zero☆16Nov 5, 2024Updated last year
- Simple web based Messaging app built with Nodejs.☆16Feb 1, 2023Updated 3 years ago
- Register using valid invitation code backend for django-registration☆22Jul 14, 2010Updated 15 years ago
- simple python gevent web spider☆23Jun 27, 2011Updated 14 years ago
- CRACK AND CHECK HASH TYPES IN BULK☆13Jul 28, 2021Updated 4 years ago
- A curated list of Workflow Automation Software, Engines and Tools☆28Dec 20, 2025Updated last month
- Volatility 3 plugins to extract a module as complete as possible☆12Jun 13, 2023Updated 2 years ago
- A collection of hardware Trojans (HTs) automatically generated by Large Language Models (GPT-4, Gemini-1.5-pro, and LLaMA3) targeting SRA…☆11Oct 8, 2025Updated 4 months ago
- WebSocket library for Python (ws4py)☆13Apr 26, 2012Updated 13 years ago
- ☆10Nov 26, 2022Updated 3 years ago
- PolyCaptcha is a Flask‑based web application that mimics Google’s image‑based reCAPTCHA flow to demonstrate how attackers can use visual …☆10Jul 24, 2025Updated 6 months ago
- 🗑 JSON { BIN } IT!☆10Jan 27, 2023Updated 3 years ago
- Password generation from the menu bar☆12Oct 8, 2021Updated 4 years ago
- simple tool for finding javascript files from webapps☆10Apr 20, 2023Updated 2 years ago
- ☆10May 29, 2023Updated 2 years ago
- ☆10Jan 29, 2026Updated 2 weeks ago
- An airflow deployment configuration with sane defaults☆10Jun 6, 2019Updated 6 years ago
- Use Ionicons in Sass as inline SVG, no images or webfonts needed☆12Jan 6, 2023Updated 3 years ago
- Restoring some of my older tools to the web☆12Oct 18, 2024Updated last year
- Use Googlemap on your Django app☆18Aug 17, 2012Updated 13 years ago