A curated list of AI-powered web scraping tools, LLM-friendly crawlers, MCP servers, and infrastructure for turning the web into data.
☆97May 18, 2026Updated 3 months ago
Alternatives and similar repositories for awesome-ai-web-scraping
Users that are interested in awesome-ai-web-scraping are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Undetected Playwright for Android. Real Android device in Docker (Redroid), driven via CDP with OS-level stealth. While every other antid…☆309Jul 5, 2026Updated 2 months ago
- CLI recon tool for scraper developers. Detects TLS fingerprinting, JS challenges, bot protection, and rate limits across 4 stages☆44May 23, 2026Updated 3 months ago
- Powerful Google Maps Crawler / Scraper tool with REST API, Docker support & multi-format export☆86Aug 22, 2026Updated 3 weeks ago
- A Magisk/KernelSU module that installs OpenClaw on Android (aarch64) with bundled glibc-node runtime☆14May 4, 2026Updated 4 months ago
- The frontend for GoDoxy☆18Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A high-performance drop-in replacement for Python's BeautifulSoup☆24Jul 21, 2026Updated last month
- A TypeScript client for the Granola API☆16Aug 18, 2025Updated last year
- Random prompts and Claude commands☆17Sep 11, 2025Updated last year
- A production-ready, provider-agnostic Node.js SDK for End-to-End RAG (Retrieval-Augmented Generation) pipelines.☆42Aug 9, 2026Updated last month
- A flexible CLI tool that uses Google's Gemini API to process images with customizable prompts. Perfect for batch processing slides, photo…☆20Jul 7, 2026Updated 2 months ago
- A self-healing scraper for hostile sites: broken selectors repair themselves, browser rendering kicks in when needed, and a coherent iden…☆113Sep 2, 2026Updated last week
- ☆15Jul 5, 2026Updated 2 months ago
- Draft to Take beta: local-first AI audio production studio powered by IndexTTS2, Docker, Qwen, OmniVoice, SFX, ambience, and music sideca…☆77Aug 12, 2026Updated last month
- Project Name is the filename of the script without release number !☆15Dec 14, 2025Updated 8 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Visual session-state signals for OpenCode using its native theme system☆21Jul 17, 2026Updated last month
- AI Browser Automation Framework☆202Aug 1, 2026Updated last month
- Klura watches what the browser actually does — requests, responses, tokens — and turns it into a reusable API call.☆60Sep 3, 2026Updated last week
- Candid reviews of Claude Code skills. File:line citations. Ranked actions. No filler.☆52Aug 28, 2026Updated 2 weeks ago
- aaPanel Private☆14Nov 27, 2025Updated 9 months ago
- ☆22May 11, 2021Updated 5 years ago
- 📸 Simplifying photo management on desktop via mobile with a client-server setup. Upload, organize, and share photos seamlessly using loc…☆40Mar 11, 2026Updated 6 months ago
- Local ears and mouth for your LLM — offline, private, safe, free & open source. Voice-enable any local LLM stack: Claude Code, OpenCode, …☆44Updated this week
- ☆13Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A lightweight and flexible fetch enhancement library that works with vanilla JavaScript, React, and Preact.☆15Apr 9, 2025Updated last year
- CORS Exploit POC for WordPress REST API☆11Oct 27, 2024Updated last year
- AI-powered customer support agent with WhatsApp, Email & Phone channels☆127Apr 14, 2026Updated 4 months ago
- ☆54Jan 15, 2026Updated 7 months ago
- documentation on the data-dome captcha payload☆29Feb 1, 2023Updated 3 years ago
- This version of CompVis/stable-diffusion features an interactive command-line script that combines text2img and img2img functionality in …☆13Oct 3, 2022Updated 3 years ago
- ☆61Jan 15, 2026Updated 7 months ago
- YoutubeMusic Downloader & Exporter☆72Sep 1, 2026Updated last week
- ☆20Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Lightweight server for developing conversational agents using Microsoft AutoGen 0.4☆25Mar 20, 2025Updated last year
- the best token is the token never spent☆31Aug 3, 2026Updated last month
- A chat application hosted on CF workers built with preact☆16Apr 26, 2026Updated 4 months ago
- Repo to store binary targets☆23Updated this week
- Automate faster with n8n templates. Connect apps like Gmail and Slack with ready-to-use, AI-powered workflows. Save time and boost produc…☆15May 13, 2025Updated last year
- An delay-based audio effects plugin.☆18May 2, 2024Updated 2 years ago
- An easy to use tool to sideload APK apps intended for use with the Oculus Quest and Go☆15May 2, 2019Updated 7 years ago