A list of libraries, tools, and APIs for web scraping and data processing. Find everything you need for extracting, managing, and processing data from the web, from HTTP libraries to browser automation tools and proxy services.
☆22Apr 6, 2025Updated last year
Alternatives and similar repositories for Awesome-Web-Scraping
Users that are interested in Awesome-Web-Scraping are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Open-source collection of AI agents covering web scraping, discovery, and data extraction. Each agent includes detailed documentation an…☆32Feb 9, 2026Updated 5 months ago
- AI-powered tool that scrapes Google, extracts web content via Bright Data MCP, and uses AI to generate research-based articles with outli…☆20Sep 21, 2025Updated 10 months ago
- ☆15Sep 17, 2025Updated 10 months ago
- Ideas, tricks, materials with puzzles for AIs and some wetware☆15Updated this week
- AI Reddit bot that scrapes subreddits for questions, conducts research, and posts automated answers to help users with relevant informati…☆22Sep 13, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A swarm of LLM agents that will help you test, document, and productionize your code!☆19Jul 13, 2026Updated last week
- Integrate Claude Code and Gemini CLI into your Obsidian workflow☆27May 28, 2026Updated last month
- Obsidian plugin for integrating with LLM CLI tools (Claude, Codex, OpenCode, Gemini)☆31Jun 14, 2026Updated last month
- Scripts created by AI Agents to use as tools for data collection. These are examples of Inforensics JITT (Just-In-Time Tool) Agent.☆15Jul 7, 2024Updated 2 years ago
- Agentset MCP Server - Build RAG with Agentic superpowers☆30Jun 16, 2025Updated last year
- Task management for AI agents☆17Jun 25, 2025Updated last year
- Gradio UI to load crewAI configuration from excel xls and generate the python code. The source of the crews is in the xls. It allows for …☆10Oct 17, 2025Updated 9 months ago
- Appscript to pull stats from gmail and store in a google sheet☆10Mar 20, 2021Updated 5 years ago
- Plivo github actions☆14Nov 29, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Add real-time Speech-to-Text to your LiveKit application with AssemblyAI☆20Jun 5, 2025Updated last year
- 摸鱼派聊天室python客户端 ｜🥷 账号多开 ｜💗免密登陆 ｜ ❤️丰富的快捷命令 ｜🌈自定义字体颜色 ｜🧧 红包脚本 ｜ 配置导出☆10May 7, 2025Updated last year
- Comprehensive AI-powered knowledge management system implementing the Zettelkasten method. Features atomic note creation, full-text searc…☆35Sep 15, 2025Updated 10 months ago
- ☆11Feb 17, 2022Updated 4 years ago
- ☆12Mar 20, 2023Updated 3 years ago
- One command automated macOS/Linux laptop/VM/container bootstrapper.☆19Updated this week
- Automate the creation of high quality research papers in latex. Powered by Swarms 🤖☆11Dec 1, 2025Updated 7 months ago
- Code samples for Ingest data with Microsoft Fabric notebooks☆10Jul 21, 2023Updated 3 years ago
- Resources for O'Reilly Online Learning course, "First Steps with Power Query for Microsoft Excel"☆11Sep 22, 2021Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Apps Script applications to connect Data Studio to external data sources☆13Sep 20, 2018Updated 7 years ago
- A collection of all the Google Data Studio Community Connectors that I've built over time.☆11Jun 17, 2022Updated 4 years ago
- ☆12Jan 27, 2026Updated 5 months ago
- A powerful Model Context Protocol (MCP) server that creates other MCP servers! This meta-server provides tools for dynamically generating…☆41Jun 18, 2025Updated last year
- Power Query Examples, with a bit of monkey business.☆11Oct 11, 2025Updated 9 months ago
- Building a multi-agent RAG system with advanced RAG methods☆13Jan 12, 2025Updated last year
- A simple agent powered by LLMs that performs tasks.☆15Apr 25, 2025Updated last year
- rUv-Engineer - let's you describe UI using your imagination, then see it rendered live.☆13Sep 28, 2024Updated last year
- Real-Time Open-Vocabulary Object Detection☆12Feb 7, 2024Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Custom tools for agent based crewAI langchain solutions☆10May 27, 2024Updated 2 years ago
- Engaging visualisations, made easy.☆14Aug 7, 2024Updated last year
- Demo App☆11Jan 27, 2026Updated 5 months ago
- Auto-generated sphinx version of the IPython website. Since this is an auto-generated directory, do *not* submit pull requests against th…☆11Jun 2, 2026Updated last month
- Using Plotly to create a heatmap visualization of monthly and hourly data☆13Aug 9, 2021Updated 4 years ago
- These are my personal data analysis projects. I mainly used R/Python programming for my data analysis. And also used BI tools such as Tab…☆15Dec 12, 2025Updated 7 months ago
- Building a more intelligent world.☆11Apr 29, 2024Updated 2 years ago