A list of libraries, tools, and APIs for web scraping and data processing. Find everything you need for extracting, managing, and processing data from the web, from HTTP libraries to browser automation tools and proxy services.
☆27Apr 6, 2025Updated last year
Alternatives and similar repositories for Awesome-Web-Scraping
Users that are interested in Awesome-Web-Scraping are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Open-source collection of AI agents covering web scraping, discovery, and data extraction. Each agent includes detailed documentation an…☆33Feb 9, 2026Updated 7 months ago
- bulk image downloader freeware, reddit bulk image downloader, bulk image downloader extension, bulk image downloader from url, bulk image…☆26Feb 19, 2026Updated 7 months ago
- A Python tool utilizing Selenium for automated extraction of funding round data from Crunchbase.☆16May 20, 2025Updated last year
- Advanced PDF parsing for python☆12Jan 21, 2025Updated last year
- Ideas, tricks, materials with puzzles for AIs and some wetware☆15Sep 12, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 🏛️ Direito Lux - SaaS para monitoramento automatizado de processos jurídicos com integração DataJud (CNJ)☆17Jul 18, 2025Updated last year
- AI Reddit bot that scrapes subreddits for questions, conducts research, and posts automated answers to help users with relevant informati…☆22Sep 13, 2024Updated 2 years ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆20Aug 29, 2026Updated 3 weeks ago
- Integrate Claude Code and Gemini CLI into your Obsidian workflow☆27May 28, 2026Updated 3 months ago
- Python library for extracting headers, footers and body from PDF☆33Jun 16, 2026Updated 3 months ago
- Obsidian plugin for integrating with LLM CLI tools (Claude, Codex, OpenCode, Gemini)☆33Jun 14, 2026Updated 3 months ago
- Raspador (sempre incompleto) de tribunais do sistema judiciário.☆49Updated this week
- Task management for AI agents☆16Jun 25, 2025Updated last year
- Appscript to pull stats from gmail and store in a google sheet☆10Mar 20, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Plivo github actions☆14Nov 29, 2022Updated 3 years ago
- Automated content cross posting from Notion Database to Dev.to, Hashnode, Medium, Twitter, and LinkedIn using GitHub Actions.☆14Oct 21, 2024Updated last year
- 摸鱼派聊天室python客户端 |🥷 账号多开 |💗免密登陆 | ❤️丰富的快捷命令 |🌈自定义字体颜色 |🧧 红包脚本 | 配置导出☆10May 7, 2025Updated last year
- A MCP (Model Context Protocol) server for agent-driven research on Brazilian law using official sources☆36Jul 29, 2025Updated last year
- ☆13Mar 20, 2023Updated 3 years ago
- A collection of all the Google Data Studio Community Connectors that I've built over time.☆12Jun 17, 2022Updated 4 years ago
- ☆11Feb 17, 2022Updated 4 years ago
- ☆40Jun 13, 2025Updated last year
- Automate the creation of high quality research papers in latex. Powered by Swarms 🤖☆11Dec 1, 2025Updated 9 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- I saw this [Blog Post](https://www.morling.dev/blog/one-billion-row-challenge/) on a Billion Row challenge for Java so naturally I tried …☆14Jan 10, 2024Updated 2 years ago
- Code samples for Ingest data with Microsoft Fabric notebooks☆10Jul 21, 2023Updated 3 years ago
- Resources for O'Reilly Online Learning course, "First Steps with Power Query for Microsoft Excel"☆11Sep 22, 2021Updated 4 years ago
- Apps Script applications to connect Data Studio to external data sources☆13Sep 20, 2018Updated 7 years ago
- Building a multi-agent RAG system with advanced RAG methods☆13Jan 12, 2025Updated last year
- ☆12Aug 1, 2026Updated last month
- Power Query Examples, with a bit of monkey business.☆11Oct 11, 2025Updated 11 months ago
- rUv-Engineer - let's you describe UI using your imagination, then see it rendered live.☆15Sep 28, 2024Updated last year
- Custom tools for agent based crewAI langchain solutions☆10May 27, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Real-Time Open-Vocabulary Object Detection☆12Feb 7, 2024Updated 2 years ago
- Auto-generated sphinx version of the IPython website. Since this is an auto-generated directory, do *not* submit pull requests against th…☆11Jun 2, 2026Updated 3 months ago
- Engaging visualisations, made easy.☆14Aug 7, 2024Updated 2 years ago
- Building a more intelligent world.☆11Apr 29, 2024Updated 2 years ago
- Machine Learning Data Fairness and Bias☆15Apr 29, 2026Updated 4 months ago
- These are my personal data analysis projects. I mainly used R/Python programming for my data analysis. And also used BI tools such as Tab…☆15Dec 12, 2025Updated 9 months ago
- ☆14Apr 18, 2024Updated 2 years ago