A curated list of AI-powered web scraping tools, LLM-friendly crawlers, MCP servers, and infrastructure for turning the web into data.
☆131May 18, 2026Updated 6 months ago
Alternatives and similar repositories for awesome-ai-web-scraping
Users that are interested in awesome-ai-web-scraping are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆26Sep 27, 2026Updated last month
- Slack for AI Agents☆23Mar 6, 2026Updated 8 months ago
- Local-first, eval-first memory for long-horizon AI agents — no LLM at ingest. Python SDK + MCP server with source-traceable recall, belie…☆14Jul 28, 2026Updated 3 months ago
- Powerful Google Maps Crawler / Scraper tool with REST API, Docker support & multi-format export☆96Updated this week
- [ICLR 2023 Oral] Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model☆16Apr 25, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Undetected Playwright for Android. Real Android device in Docker (Redroid), driven via CDP with OS-level stealth. While every other antid…☆369Jul 5, 2026Updated 4 months ago
- The frontend for GoDoxy☆18Updated this week
- Turn saved links into reusable skills for builders.☆18Jul 8, 2026Updated 4 months ago
- OCR of Bank Statement - Infosys Springboard 5.0. This this project I developed a fully functional website for OCR of bank or financial do…☆12Jan 4, 2025Updated last year
- Efficient Node.js tool for deobfuscating hsv hCaptcha file using Babel AST. Features include WASM extraction, worker deobfuscation, and v…☆19Dec 19, 2023Updated 2 years ago
- Your AI-native partner for brainstorming research and project ideas. 你的AI原生伙伴,专注科研与项目创意的头脑风暴。☆11Sep 24, 2025Updated last year
- ☆37Updated this week
- ☆20Apr 6, 2025Updated last year
- A production-ready, provider-agnostic Node.js SDK for End-to-End RAG (Retrieval-Augmented Generation) pipelines.☆42Aug 9, 2026Updated 3 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Blazor-native AI agent UX components and workflow chat for .NET apps.☆15Jun 18, 2026Updated 5 months ago
- Penpot plugin to generate design md skill files based on TypeUI☆16Apr 9, 2026Updated 7 months ago
- An offline desktop Text-to-Speech (TTS) studio built with Electron and the Qvac sdk☆39Updated this week
- Vibe code and chat with AI without internet - offline, local, powered by Gemma 4☆19Apr 20, 2026Updated 6 months ago
- Cross-compat library for parsing Apple Archive + Apple Encrypted Archive (.aar/.yaa/.aea).☆46Nov 8, 2026Updated last week
- ☆13Jul 26, 2026Updated 3 months ago
- Secure (with AEAD) version of USTP, called USTP-Secure (ustps://)☆14Aug 2, 2026Updated 3 months ago
- My first Python AI assistant inspired by Iron Man, built with speech recognition and modular skills☆10May 13, 2026Updated 6 months ago
- Google meet CRUD operations in PHP through Google Calendar API.☆11Mar 23, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- MCP server for Apple Mail: sub-ms search over 300k+ messages via Mail's own SQLite index, verified sends, Exchange body backfill, triage …☆37Updated this week
- A no-nonsense goal workflow engine — keeps your AI on a plan you can read, decide on, and trust. Works with Claude Code & Codex.☆17Sep 26, 2026Updated last month
- stores version numbers of common mise plugins☆30Updated this week
- Utility for looking up Unicode characters and HTML entities by code, name, block, or description. Written in Perl, compatible with almos…☆20Oct 22, 2023Updated 3 years ago
- ☆14Jul 10, 2024Updated 2 years ago
- ☆28Oct 21, 2026Updated 3 weeks ago
- ☆20Updated this week
- MachO's Other Tooling☆13Aug 24, 2026Updated 2 months ago
- stream-of-consciousness experience of an AI's thinking process, complete with creative tangents and unexpected connections.☆14Jan 29, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A lightweight tool that starts a web server and returns the client's IP address on every request☆19Mar 6, 2022Updated 4 years ago
- ☆22May 11, 2021Updated 5 years ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆20Oct 26, 2026Updated 3 weeks ago
- One read() call for AI agents, stitched from 41 web tools.☆120Nov 6, 2026Updated last week
- Open-Source Apple Archive CLI tool for Linux+macOS☆13Nov 8, 2026Updated last week
- Simplest possible chat - Next.js, Shadcn, Supabase☆12Apr 22, 2025Updated last year
- The mindful CI: ephemeral, autoscaling runners that live on your Mac for GitHub Actions, GitLab CI/CD and Gitea/Forgejo Actions. Plus sto…☆17Updated this week
Are these results useful?