A curated list of AI-powered web scraping tools, LLM-friendly crawlers, MCP servers, and infrastructure for turning the web into data.
☆85May 18, 2026Updated 3 months ago
Alternatives and similar repositories for awesome-ai-web-scraping
Users that are interested in awesome-ai-web-scraping are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Undetected Playwright for Android. Real Android device in Docker (Redroid), driven via CDP with OS-level stealth. While every other antid…☆287Jul 5, 2026Updated last month
- Powerful Google Maps Crawler / Scraper tool with REST API, Docker support & multi-format export☆85Updated this week
- The frontend for GoDoxy☆18Updated this week
- vigil-rs is a PID 1 / container init daemon written in Rust. It supervises multiple processes, runs health checks, and exposes a REST API…☆26May 8, 2026Updated 3 months ago
- A high-performance drop-in replacement for Python's BeautifulSoup☆24Jul 21, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Random prompts and Claude commands☆17Sep 11, 2025Updated 11 months ago
- A flexible CLI tool that uses Google's Gemini API to process images with customizable prompts. Perfect for batch processing slides, photo…☆20Jul 7, 2026Updated last month
- A self-healing scraper for hostile sites: broken selectors repair themselves, browser rendering kicks in when needed, and a coherent iden…☆110Jul 19, 2026Updated last month
- A swiss army knife for CLI operations catered to devs and security professionals.☆30Aug 3, 2026Updated 2 weeks ago
- Google Maps scraper, but it uses HTTP requests instead of a browser☆92Jul 14, 2026Updated last month
- ☆25Apr 20, 2026Updated 4 months ago
- Taskbar widget for Spotify — now playing with full controls embedded in the Windows 11 taskbar (unofficial, not affiliated with Spotify A…☆62Aug 5, 2026Updated 2 weeks ago
- I use this repo to make builds of all the latest PRs/experimental features that haven't made it into nightly yet.☆10Feb 22, 2023Updated 3 years ago
- Draft to Take beta: local-first AI audio production studio powered by IndexTTS2, Docker, Qwen, OmniVoice, SFX, ambience, and music sideca…☆74Aug 12, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Production-grade memory operating system for agentic AI. Interoperates with every major framework via MCP, OpenAI-compatible gateway, and…☆29Updated this week
- A simple tweak to add power settings to the Settings app.☆15Mar 2, 2025Updated last year
- TUI for combining source code files into LLM-ready prompts: tree explorer, syntax preview, token estimation, and structured XML output☆20Updated this week
- Visual session-state signals for OpenCode using its native theme system☆18Jul 17, 2026Updated last month
- AI coding assistant with code traceability☆35Jul 19, 2026Updated last month
- Candid reviews of Claude Code skills. File:line citations. Ranked actions. No filler.☆24Aug 7, 2026Updated 2 weeks ago
- A simple docker to torrent within Heroku to transfer the files to your Mega drive.☆13May 21, 2021Updated 5 years ago
- Unflare helps you to bypass Cloudflare protection☆176Jul 16, 2025Updated last year
- ☆22May 11, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Local ears and mouth for your LLM — offline, private, safe, free & open source. Voice-enable any local LLM stack: Claude Code, OpenCode, …☆43Updated this week
- ☆10Oct 2, 2020Updated 5 years ago
- golang http proxy with ja3 support☆36Jun 7, 2025Updated last year
- AI-powered customer support agent with WhatsApp, Email & Phone channels☆120Apr 14, 2026Updated 4 months ago
- ☆55Jan 15, 2026Updated 7 months ago
- ☆10Jan 24, 2023Updated 3 years ago
- Plex AsiaN Drama Agent☆11May 4, 2020Updated 6 years ago
- documentation on the data-dome captcha payload☆29Feb 1, 2023Updated 3 years ago
- Browser's console code to download the read-only Gdrive pdfs.☆12May 5, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Bose Firmware - cd (Bose 321 GS GSX GSXL, Lifestyle 18 28 35 38 48 I II III IV, V10 V20 V30, AV18 AV28 AV38 AV48 MC1 AV321 AV321GS AV321G…☆13Nov 14, 2025Updated 9 months ago
- Firmware for ESCape32 Wi-Fi Link☆15Jul 11, 2026Updated last month
- Fast & Lightweight TypeScript Validation Library☆16Updated this week
- This sample demonstrates how to use the Microsoft Graph JavaScript SDK to access data in Office 365 from Office Add-ins.☆14May 26, 2025Updated last year
- the best token is the token never spent☆31Aug 3, 2026Updated 2 weeks ago
- ☆11Apr 9, 2016Updated 10 years ago
- SharePoint Web Parts☆12Aug 26, 2013Updated 12 years ago