A curated list of AI-powered web scraping tools, LLM-friendly crawlers, MCP servers, and infrastructure for turning the web into data.
☆73May 18, 2026Updated last month
Alternatives and similar repositories for awesome-ai-web-scraping
Users that are interested in awesome-ai-web-scraping are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI-Ready React Template: A feature-based React architecture optimized for AI-assisted development with comprehensive patterns, documentat…☆23May 5, 2026Updated 2 months ago
- Undetected Playwright for Android. Real Android device in Docker (Redroid), driven via CDP with OS-level stealth. While every other antid…☆236Jul 5, 2026Updated last week
- Powerful Google Maps Crawler / Scraper tool with REST API, Docker support & multi-format export☆82Jun 16, 2026Updated 3 weeks ago
- CLI recon tool for scraper developers. Detects TLS fingerprinting, JS challenges, bot protection, and rate limits across 4 stages☆42May 23, 2026Updated last month
- A Claude Code skill that scaffolds ready-to-run LangChain Deep Agents and dcode CLI agents into any project.☆47Jun 23, 2026Updated 3 weeks ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆61Jan 15, 2026Updated 5 months ago
- A self-healing web scraper built for hostile sites: selectors repair themselves, browser rendering kicks in when needed, and Chrome TLS f…☆99Updated this week
- CLI, MCP server, and npm library that turns any website into an API — no docs, no SDK, no browser.☆90May 29, 2026Updated last month
- ☆13Updated this week
- Production-grade memory operating system for agentic AI. Interoperates with every major framework via MCP, OpenAI-compatible gateway, and…☆29Updated this week
- A governed local AI build-and-memory system that trains small brains, compares them, protects the better one, archives the worse one, and…☆27May 16, 2026Updated last month
- Efficient Node.js tool for deobfuscating hsv hCaptcha file using Babel AST. Features include WASM extraction, worker deobfuscation, and v…☆18Dec 19, 2023Updated 2 years ago
- AI-powered customer support agent with WhatsApp, Email & Phone channels☆106Apr 14, 2026Updated 3 months ago
- Turn any skill into a standalone, runnable AI Agent☆62Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆22May 11, 2021Updated 5 years ago
- Turn Keyboard LEDs on periodically (GNU/Linux)☆15Mar 28, 2025Updated last year
- ☆10Jan 24, 2023Updated 3 years ago
- AssemblyScript benchmarking library☆11Jan 11, 2024Updated 2 years ago
- aaPanel Private☆14Nov 27, 2025Updated 7 months ago
- ☆11Nov 2, 2023Updated 2 years ago
- Awesome privacy tools: encrypted messaging, anonymous email, VPNs, Tor, password managers, secure file sharing, browser privacy, and self…☆62Jun 28, 2026Updated 2 weeks ago
- Browser's console code to download the read-only Gdrive pdfs.☆12May 5, 2024Updated 2 years ago
- generate informative knowledge graph from text using open source models , ollama☆23Sep 1, 2025Updated 10 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Examples using SeleniumBase — https://github.com/seleniumbase/SeleniumBase☆14Jun 23, 2026Updated 3 weeks ago
- Bose Firmware - cd (Bose 321 GS GSX GSXL, Lifestyle 18 28 35 38 48 I II III IV, V10 V20 V30, AV18 AV28 AV38 AV48 MC1 AV321 AV321GS AV321G…☆13Nov 14, 2025Updated 8 months ago
- the best token is the token never spent☆29Updated this week
- Browser extension idontcareaboutcookies recently sold out to Avast. This is a backup of the last good version.☆12Sep 16, 2022Updated 3 years ago
- Jarvis is a local voice assistant for your mac who is connected to your system.☆75Apr 22, 2026Updated 2 months ago
- A self-hosted platform for creating and managing personal AI agents. Each agent gets its own Telegram bot, custom persona, tools, memory,…☆26Jun 22, 2026Updated 3 weeks ago
- Automate faster with n8n templates. Connect apps like Gmail and Slack with ready-to-use, AI-powered workflows. Save time and boost produc…☆14May 13, 2025Updated last year
- ☆22Updated this week
- A chat application hosted on CF workers built with preact☆16Apr 26, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A curated list of vintage large language models — also called historical or time-capsule LLMs — trained from scratch on text from bounded…☆20May 9, 2026Updated 2 months ago
- ☆11Apr 9, 2016Updated 10 years ago
- Transform your ideas into engaging LinkedIn content with AI.☆13Mar 6, 2025Updated last year
- vscode (antigravity) extension that tracks your usage limits of ai models☆31Mar 12, 2026Updated 4 months ago
- A lightweight, local OpenTelemetry trace viewer☆162Updated this week
- A sample application that will allow you to modify meetings via the REST APIs☆13Jun 22, 2022Updated 4 years ago
- Fork of staging-4.0-mega branch of https://github.com/lzzy12/python-aria-mirror-bot☆11Apr 22, 2021Updated 5 years ago