A list of common crawler user agents useful for retrieving metadata from links.
☆28Mar 2, 2026Updated this week
Alternatives and similar repositories for top-crawler-agents
Users that are interested in top-crawler-agents are comparing it to the libraries listed below
Sorting:
- Setup TLS details according to `user-agent` respecting browser specific preferences.☆15Dec 30, 2025Updated 2 months ago
- A Python script that allows you to automatically scrape and download stories from your Telegram friends using the Telethon library. The s…☆26Nov 12, 2024Updated last year
- ☆15Sep 21, 2019Updated 6 years ago
- An open-source SVGs icon library☆11Jul 15, 2025Updated 7 months ago
- Before using Emagnet, please remember that with great power comes great responsibility.☆22Mar 30, 2025Updated 11 months ago
- Crawler based on a modified browser to detect online tracking.☆11Jul 19, 2023Updated 2 years ago
- Collection of exploits developed by your friendly clown☆15Oct 18, 2025Updated 4 months ago
- CVE-2024-21306 BadBlue implementation (Using DuckyScript)☆10Jul 11, 2024Updated last year
- Pentest utils☆14Oct 8, 2016Updated 9 years ago
- A mac app that sits in your menu bar and automates the clipboard content to chatGPT API and copy the response to your clipboard.☆15Apr 2, 2023Updated 2 years ago
- Import/export Spotify playlists☆12Feb 10, 2026Updated 3 weeks ago
- An open tvOS, iOS and macOS app to play free and publicly available classic movies from Internet Archive☆10Oct 30, 2022Updated 3 years ago
- simple python gevent web spider☆23Jun 27, 2011Updated 14 years ago
- ICU-WP is a Flask-based WordPress username enumeration tool. It detects WordPress sites and uses methods like author URL checks, REST API…☆14Jan 17, 2025Updated last year
- Example configuration for caddy, docker-proxy, and crowdsec together☆17Dec 15, 2025Updated 2 months ago
- Tool to try multiple paths for PHPunit RCE CVE-2017-9841☆11May 19, 2020Updated 5 years ago
- Various scripts & tools☆12Apr 22, 2024Updated last year
- The NSE Script plugin integrates with Criminal IP CTI search engine for network scanning, showing IP details like WHOIS, running products…☆15Nov 29, 2023Updated 2 years ago
- An agile, powerful Python framework for creating dynamic UIs with seamless web integration.☆11Feb 28, 2025Updated last year
- Use Googlemap on your Django app☆18Aug 17, 2012Updated 13 years ago
- Restoring some of my older tools to the web☆12Oct 18, 2024Updated last year
- PolyCaptcha is a Flask‑based web application that mimics Google’s image‑based reCAPTCHA flow to demonstrate how attackers can use visual …☆10Jul 24, 2025Updated 7 months ago
- A curated list of best ai tools☆34Aug 20, 2025Updated 6 months ago
- Fortune cookie app for Flipper Zero☆16Nov 5, 2024Updated last year
- Simple Video Summarization using Text-to-Segment Anything (Florence2 + SAM2) This project provides a video processing tool that utilizes…☆10Feb 20, 2025Updated last year
- Volatility 3 plugins to extract a module as complete as possible☆12Jun 13, 2023Updated 2 years ago
- An airflow deployment configuration with sane defaults☆10Jun 6, 2019Updated 6 years ago
- Web page preview and analysis tool☆12Jan 11, 2023Updated 3 years ago
- simple tool for finding javascript files from webapps☆10Apr 20, 2023Updated 2 years ago
- CLI for rendering text with headless chrome.☆11Jul 11, 2020Updated 5 years ago
- Whether you're a seasoned expert or a beginner, Kali GPT helps streamline your workflow, making penetration testing more efficient and ac…☆20Feb 9, 2026Updated 3 weeks ago
- A Flutter application to detect object using TFLite.☆13Apr 13, 2023Updated 2 years ago
- Google Bard Desktop Application (Mac, Windows and Linux)☆10Jun 7, 2023Updated 2 years ago
- Profile readme☆10Oct 30, 2025Updated 4 months ago
- Clickme is a powerful multi-step clickjacking tool designed for security professionals. Create, visualize, and demonstrate complex clickj…☆14Sep 4, 2025Updated 6 months ago
- ipod☆16Jan 14, 2025Updated last year
- A collection of hardware Trojans (HTs) automatically generated by Large Language Models (GPT-4, Gemini-1.5-pro, and LLaMA3) targeting SRA…☆11Oct 8, 2025Updated 4 months ago
- Python script that types out the text that exists in clipboard.☆12Mar 31, 2025Updated 11 months ago
- a minimalistic microservice to generate and resolve sharable dynamic link (a.k.a deeplink)☆11Jan 27, 2022Updated 4 years ago