A list of libraries, tools, and APIs for web scraping and data processing. Find everything you need for extracting, managing, and processing data from the web, from HTTP libraries to browser automation tools and proxy services.
☆29Apr 6, 2025Updated last year
Alternatives and similar repositories for Awesome-Web-Scraping
Users that are interested in Awesome-Web-Scraping are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The most comprehensive, curated collection of MCP servers with ready-to-use configurations☆18Updated this week
- The definitive list of the latest libraries, tools, APIs and providers for web scraping. The only daily-updated collection of web scrapin…☆18Updated this week
- Open-source collection of AI agents covering web scraping, discovery, and data extraction. Each agent includes detailed documentation an…☆33Feb 9, 2026Updated 9 months ago
- AI-powered Amazon analytics: Get product insights, deal detection, and market trends from 23 marketplaces with interactive dashboards and…☆18Oct 8, 2025Updated last year
- A Python tool that automates LinkedIn job search, ranking, and export by combining Bright Data's LinkedIn Job Listings API with OpenAI-po…☆14Aug 28, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Framework para construir sistemas agênticos usando apenas prompts. Zero código. 100% arquitetura de linguagem.☆17Jan 30, 2026Updated 9 months ago
- Bulk domain/website change monitoring tool w/ screen capture, gallery, and email notification☆20May 24, 2019Updated 7 years ago
- ☆17Sep 17, 2025Updated last year
- CLI for Google Ads API☆14Mar 20, 2026Updated 7 months ago
- Stop being lost in a codebase. CLI + Claude Code skill that builds an import graph, runs PageRank to find the files holding a repo togeth…☆17Jul 3, 2026Updated 4 months ago
- Rotina de scraping para jurisprudência do TJPR☆12Mar 25, 2023Updated 3 years ago
- Advanced PDF parsing for python☆12Jan 21, 2025Updated last year
- Integrate Claude Code and Gemini CLI into your Obsidian workflow☆27May 28, 2026Updated 5 months ago
- AI-driven tool for automatically collecting, analyzing, and generating actionable insights from customer reviews across multiple platform…☆27Aug 27, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Parser de remissões entre normas legislativas☆13Aug 11, 2026Updated 3 months ago
- Type-safe code generator for GraphQL schemas — produces clients and server interfaces for Dart, Flutter, Java, and Spring Boot.…☆19Updated this week
- Ideas, tricks, materials with puzzles for AIs and some wetware☆17Updated this week
- Interactive landscape of the open standards that power a modern data architecture — data-landscape.com☆27Nov 7, 2026Updated last week
- Specialist agent, marketing, product, scientific, and engineering workflows as Claude Code & Codex-compatible skills☆26Jun 30, 2026Updated 4 months ago
- Cross-platform, free, open-source suite for PDF processing that provides commonly requested features via multiple front-ends and a shared…☆27Jul 14, 2026Updated 4 months ago
- 🏛️ Direito Lux - SaaS para monitoramento automatizado de processos jurídicos com integração DataJud (CNJ)☆19Jul 18, 2025Updated last year
- AI-powered tool to audit and optimize website content by crawling URLs, analyzing H1s, and generating actionable GEO recommendations with…☆171Oct 20, 2025Updated last year
- ☆18Oct 12, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Master Orchestrator for Gemini, Codex & Claude☆18Aug 27, 2025Updated last year
- Claude Code skill that turns any codebase into a self-hosted interactive explainer website with dependency graphs, diagrams, and full sea…☆13Mar 28, 2026Updated 7 months ago
- This is a tool to crack passwords from zip files☆10Oct 16, 2025Updated last year
- CVE-2020-1337 a bypass of (PrintDemon) CVE-2020-1048’s patch☆16Aug 11, 2020Updated 6 years ago
- ☆19Oct 26, 2026Updated 3 weeks ago
- Collection of Public information and reports regarding Pegasus spyware by NSO☆10Jul 22, 2021Updated 5 years ago
- Unofficial MCP server for cosmos.so. Search, browse and build visual moodboards with Claude, Cursor or any MCP client.☆17Aug 5, 2026Updated 3 months ago
- Xninjaz is a powerful and versatile multi-vulnerability scanner designed to detect various web application vulnerabilities, including Loc…☆12Oct 16, 2025Updated last year
- FIO API wrapper. Access Prosperous Universe game data in Python.☆10Apr 21, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Turn a product + an actor reference photo into a seamless ~20s UGC talking-head ad — Claude Code skill with machine-enforced prompt gates…☆18Jul 17, 2026Updated 4 months ago
- Xbot-ddos is a ddos-attack tool that attacks servers by IP address and sends as many bots as possible to flood the server.☆10Oct 16, 2025Updated last year
- A collection of multiple e-commerce dataset samples. Each sample contains over 1,000 records. These datasets are ideal for product trend …☆90Feb 10, 2026Updated 9 months ago
- For those of you who like playing games,you can install this tool☆11Oct 16, 2025Updated last year
- 190+ agent skills for Claude Code, Codex, Gemini CLI, Cursor, and 40+ other agents. Apache-2.0.☆18Nov 6, 2026Updated last week
- X-whois is an internet protocol used to search for information about a domain. X-whois information includes domain name, server name, cre…☆10Oct 16, 2025Updated last year
- ☆19Oct 5, 2026Updated last month
Are these results useful?