A list of libraries, tools, and APIs for web scraping and data processing. Find everything you need for extracting, managing, and processing data from the web, from HTTP libraries to browser automation tools and proxy services.
☆27Apr 6, 2025Updated last year
Alternatives and similar repositories for Awesome-Web-Scraping
Users that are interested in Awesome-Web-Scraping are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🏛️ Direito Lux - SaaS para monitoramento automatizado de processos jurídicos com integração DataJud (CNJ)☆18Jul 18, 2025Updated last year
- Master Orchestrator for Gemini, Codex & Claude☆18Aug 27, 2025Updated last year
- A python implementation of delta debugging tool.☆27Feb 9, 2024Updated 2 years ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆20Updated this week
- Integrate Claude Code and Gemini CLI into your Obsidian workflow☆27May 28, 2026Updated 4 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Python library for extracting headers, footers and body from PDF☆33Jun 16, 2026Updated 3 months ago
- Obsidian plugin for integrating with LLM CLI tools (Claude, Codex, OpenCode, Gemini)☆33Jun 14, 2026Updated 3 months ago
- Task management for AI agents☆16Jun 25, 2025Updated last year
- Gradio UI to load crewAI configuration from excel xls and generate the python code. The source of the crews is in the xls. It allows for …☆10Oct 17, 2025Updated 11 months ago
- Agentset MCP Server - Build RAG with Agentic superpowers☆30Jun 16, 2025Updated last year
- Plivo github actions☆14Nov 29, 2022Updated 3 years ago
- Automated content cross posting from Notion Database to Dev.to, Hashnode, Medium, Twitter, and LinkedIn using GitHub Actions.☆14Oct 21, 2024Updated last year
- 摸鱼派聊天室python客户端 ｜🥷 账号多开 ｜💗免密登陆 ｜ ❤️丰富的快捷命令 ｜🌈自定义字体颜色 ｜🧧 红包脚本 ｜ 配置导出☆10May 7, 2025Updated last year
- A MCP (Model Context Protocol) server for agent-driven research on Brazilian law using official sources☆38Jul 29, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A collection of all the Google Data Studio Community Connectors that I've built over time.☆12Jun 17, 2022Updated 4 years ago
- ☆11Feb 17, 2022Updated 4 years ago
- ☆42Jun 13, 2025Updated last year
- Automate the creation of high quality research papers in latex. Powered by Swarms 🤖☆11Dec 1, 2025Updated 10 months ago
- I saw this [Blog Post](https://www.morling.dev/blog/one-billion-row-challenge/) on a Billion Row challenge for Java so naturally I tried …☆14Jan 10, 2024Updated 2 years ago
- Code samples for Ingest data with Microsoft Fabric notebooks☆10Jul 21, 2023Updated 3 years ago
- Resources for O'Reilly Online Learning course, "First Steps with Power Query for Microsoft Excel"☆11Sep 22, 2021Updated 5 years ago
- Building a multi-agent RAG system with advanced RAG methods☆13Jan 12, 2025Updated last year
- ☆12Aug 1, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A powerful Model Context Protocol (MCP) server that creates other MCP servers! This meta-server provides tools for dynamically generating…☆40Jun 18, 2025Updated last year
- Power Query Examples, with a bit of monkey business.☆11Oct 11, 2025Updated 11 months ago
- Custom tools for agent based crewAI langchain solutions☆10May 27, 2024Updated 2 years ago
- Real-Time Open-Vocabulary Object Detection☆12Feb 7, 2024Updated 2 years ago
- Auto-generated sphinx version of the IPython website. Since this is an auto-generated directory, do *not* submit pull requests against th…☆11Jun 2, 2026Updated 4 months ago
- Engaging visualisations, made easy.☆14Aug 7, 2024Updated 2 years ago
- Comprehensive AI-powered knowledge management system implementing the Zettelkasten method. Features atomic note creation, full-text searc…☆39Sep 15, 2025Updated last year
- Building a more intelligent world.☆11Apr 29, 2024Updated 2 years ago
- Using Plotly to create a heatmap visualization of monthly and hourly data☆13Aug 9, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- These are my personal data analysis projects. I mainly used R/Python programming for my data analysis. And also used BI tools such as Tab…☆15Dec 12, 2025Updated 9 months ago
- Remote Model Context Protocol (MCP) server for Linear.☆16Apr 12, 2025Updated last year
- AI-powered cryptocurrency trading bot built using deep reinforcement learning (DRL). The bot is designed as a research platform for devel…☆11Jan 18, 2025Updated last year
- Use GPTparser with your OpenAI API to scrape & parse files into structured JSON files.☆12Apr 2, 2024Updated 2 years ago
- Easily take an entire YouTube playlist and turn it into high quality transcripts using Whisper.☆10Feb 1, 2024Updated 2 years ago
- This is a python package that helps developers to generate fake social media profiles for development purposes☆12Oct 9, 2024Updated 2 years ago
- FinanceCrew is an AI-powered tool that helps day traders analyze markets, develop strategies, and manage risks using CrewAI.☆12Aug 9, 2024Updated 2 years ago