A curated list of AI-powered web scraping tools, LLM-friendly crawlers, MCP servers, and infrastructure for turning the web into data.
☆80May 18, 2026Updated 2 months ago
Alternatives and similar repositories for awesome-ai-web-scraping
Users that are interested in awesome-ai-web-scraping are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Undetected Playwright for Android. Real Android device in Docker (Redroid), driven via CDP with OS-level stealth. While every other antid…☆258Jul 5, 2026Updated 3 weeks ago
- CLI recon tool for scraper developers. Detects TLS fingerprinting, JS challenges, bot protection, and rate limits across 4 stages☆42May 23, 2026Updated 2 months ago
- Powerful Google Maps Crawler / Scraper tool with REST API, Docker support & multi-format export☆82Jun 16, 2026Updated last month
- A Magisk/KernelSU module that installs OpenClaw on Android (aarch64) with bundled glibc-node runtime☆15May 4, 2026Updated 3 months ago
- Random prompts and Claude commands☆17Sep 11, 2025Updated 10 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Detect Credit card number using Mask RCNN and make task easier for OCR to retrive number from the card☆11Oct 8, 2019Updated 6 years ago
- Alice is a voice command based assistant service written in Python 3.8+. It can recognize human speech or voice, talk to user and execute…☆12Jul 19, 2022Updated 4 years ago
- A swiss army knife for CLI operations catered to devs and security professionals.☆29Updated this week
- This project requires to develop a customer segmentation to define marketing strategy. The sample dataset summarizes the usage behavior o…☆14Oct 14, 2019Updated 6 years ago
- Vibe code and chat with AI without internet - offline, local, powered by Gemma 4☆19Apr 20, 2026Updated 3 months ago
- YAGPDB's (new) documentation and custom commands course.☆17Jun 29, 2026Updated last month
- Evel-Eye is a modular, Bash-based camera phishing tool designed for security awareness and educational purposes. It automates the deploym…☆17Updated this week
- OKD Operator build scripts☆12Jul 13, 2026Updated 3 weeks ago
- Draft to Take beta: local-first AI audio production studio powered by IndexTTS2, Docker, Qwen, OmniVoice, SFX, ambience, and music sideca…☆72Jul 5, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Browser demo of encrypting API keys locally with scrypt recovery and passkey unlock via WebAuthn PRF.☆17Apr 1, 2026Updated 4 months ago
- Production-grade memory operating system for agentic AI. Interoperates with every major framework via MCP, OpenAI-compatible gateway, and…☆29Jul 23, 2026Updated last week
- TUI for combining source code files into LLM-ready prompts: tree explorer, syntax preview, token estimation, and structured XML output☆20Jul 3, 2026Updated last month
- Visual session-state signals for OpenCode using its native theme system☆17Jul 17, 2026Updated 2 weeks ago
- Candid reviews of Claude Code skills. File:line citations. Ranked actions. No filler.☆23Jul 22, 2026Updated last week
- AI Browser Automation Framework☆200Updated this week
- 📸 Simplifying photo management on desktop via mobile with a client-server setup. Upload, organize, and share photos seamlessly using loc…☆38Mar 11, 2026Updated 4 months ago
- Unflare helps you to bypass Cloudflare protection☆177Jul 16, 2025Updated last year
- Local ears and mouth for your LLM — offline, private, safe, free & open source. Voice-enable any local LLM stack: Claude Code, OpenCode, …☆38Jul 14, 2026Updated 3 weeks ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Nodriver integration for Scrapy☆18Dec 18, 2024Updated last year
- ☆10Oct 2, 2020Updated 5 years ago
- KALI IOS FOR iSH☆18Feb 3, 2026Updated 6 months ago
- ☆11Nov 2, 2023Updated 2 years ago
- golang http proxy with ja3 support☆36Jun 7, 2025Updated last year
- CORS Exploit POC for WordPress REST API☆11Oct 27, 2024Updated last year
- Bypass Cloudflare's jsd challenge using 100% golang☆382May 10, 2026Updated 2 months ago
- AI-powered customer support agent with WhatsApp, Email & Phone channels☆114Apr 14, 2026Updated 3 months ago
- ☆10Jan 24, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆55Jan 15, 2026Updated 6 months ago
- This version of CompVis/stable-diffusion features an interactive command-line script that combines text2img and img2img functionality in …☆13Oct 3, 2022Updated 3 years ago
- Browser's console code to download the read-only Gdrive pdfs.☆12May 5, 2024Updated 2 years ago
- A task focused web browser for working with Claude.ai chat to smooth the workflow for projects☆17Sep 3, 2025Updated 11 months ago
- ☆61Jan 15, 2026Updated 6 months ago
- Browser extension idontcareaboutcookies recently sold out to Avast. This is a backup of the last good version.☆12Sep 16, 2022Updated 3 years ago
- AI-powered application builder built with Next.js 16 that lets you create apps and websites by chatting with AI.☆21Updated this week