A list of libraries, tools, and APIs for web scraping and data processing. Find everything you need for extracting, managing, and processing data from the web, from HTTP libraries to browser automation tools and proxy services.
☆28Apr 6, 2025Updated last year
Alternatives and similar repositories for Awesome-Web-Scraping
Users that are interested in Awesome-Web-Scraping are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Python tool that automates LinkedIn job search, ranking, and export by combining Bright Data's LinkedIn Job Listings API with OpenAI-po…☆14Aug 28, 2025Updated last year
- Open-source collection of AI agents covering web scraping, discovery, and data extraction. Each agent includes detailed documentation an…☆33Feb 9, 2026Updated 8 months ago
- AI-powered BDR/SDR system that automates lead discovery, trigger detection, contact research, personalized outreach, and CRM integration …☆19Sep 30, 2025Updated last year
- AI-powered tool that scrapes Google, extracts web content via Bright Data MCP, and uses AI to generate research-based articles with outli…☆21Sep 21, 2025Updated last year
- CLI for Google Ads API☆14Mar 20, 2026Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆17Sep 17, 2025Updated last year
- A Python tool utilizing Selenium for automated extraction of funding round data from Crunchbase.☆16May 20, 2025Updated last year
- A simple microservice designed in Go using Echo Microframework for sending emails and/or calendar invitations to users.☆13Aug 11, 2022Updated 4 years ago
- Specialist agent, marketing, product, scientific, and engineering workflows as Claude Code & Codex-compatible skills☆24Jun 30, 2026Updated 3 months ago
- Generate letter avatars in Ruby on Rails☆11Feb 18, 2021Updated 5 years ago
- Local AI proxy for Cline, Continue, Aider, Ollama, LM Studio, and OpenAI-compatible tools. Reduce repeated tokens, compress long sessions…☆13Jul 5, 2026Updated 3 months ago
- AI-driven tool for automatically collecting, analyzing, and generating actionable insights from customer reviews across multiple platform…☆26Aug 27, 2025Updated last year
- An HTML-first data grid for Stimulus.js (Hotwire).☆14Oct 21, 2026Updated last week
- Interactive landscape of the open standards that power a modern data architecture — data-landscape.com☆26Oct 3, 2026Updated 3 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A Claude Code skill to dual boot your Ruby application with Bundler and next_rails☆15Jul 7, 2026Updated 3 months ago
- Foreman with TUI - Manage Procfile-based applications☆17Sep 27, 2026Updated last month
- Bright Data's python SDK, use it to call bright data's scrape and search tools. bypass any Bot-detection or Captcha and extract data from…☆99Oct 20, 2026Updated last week
- Программа ТАХОМЕТР ТРЕЙДЕРА для получения исторических данных по акциям☆13Feb 16, 2024Updated 2 years ago
- Ruby client for quickchart.io chart API☆14Apr 27, 2023Updated 3 years ago
- This is a tool to crack passwords from zip files☆10Oct 16, 2025Updated last year
- ☆23Oct 22, 2026Updated last week
- CVE-2020-1337 a bypass of (PrintDemon) CVE-2020-1048’s patch☆16Aug 11, 2020Updated 6 years ago
- ☆18Oct 5, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 190+ agent skills for Claude Code, Codex, Gemini CLI, Cursor, and 40+ other agents. Apache-2.0.☆16Updated this week
- Turn a product + an actor reference photo into a seamless ~20s UGC talking-head ad — Claude Code skill with machine-enforced prompt gates…☆16Jul 17, 2026Updated 3 months ago
- An Android home screen with Nova's depth and no internet access at all. No ads, trackers or analytics.☆40Updated this week
- Lightweight OBS-like screen recorder for Windows and Linux: hardware H.264 to MP4, desktop audio and mic, replay buffer, global hotkeys. …☆36Updated this week
- Collection of Public information and reports regarding Pegasus spyware by NSO☆10Jul 22, 2021Updated 5 years ago
- A Dockerised work environment hosted on AWS Fargate which can be SSH'd into ☁️🌎📦☆25Apr 3, 2026Updated 6 months ago
- Computable GPU Index (CGI): an open, verifiable price index for GPU compute, in USD per GPU-hour. Reproduce any published value from the …☆23Sep 24, 2026Updated last month
- Xninjaz is a powerful and versatile multi-vulnerability scanner designed to detect various web application vulnerabilities, including Loc…☆12Oct 16, 2025Updated last year
- This is an OSINT tool for searching targets using the target's username☆15Oct 16, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A Claude Code Skill to help upgrade the Rails defaults☆19Aug 20, 2026Updated 2 months ago
- A collection of multiple e-commerce dataset samples. Each sample contains over 1,000 records. These datasets are ideal for product trend …☆90Feb 10, 2026Updated 8 months ago
- Xbot-ddos is a ddos-attack tool that attacks servers by IP address and sends as many bots as possible to flood the server.☆10Oct 16, 2025Updated last year
- ‼️List of leaked NSO Pegasus's hosts, that uses to surveil.☆15Dec 18, 2021Updated 4 years ago
- ☆11Jun 22, 2025Updated last year
- For those of you who like playing games,you can install this tool☆11Oct 16, 2025Updated last year
- X-whois is an internet protocol used to search for information about a domain. X-whois information includes domain name, server name, cre…☆10Oct 16, 2025Updated last year