A list of libraries, tools, and APIs for web scraping and data processing. Find everything you need for extracting, managing, and processing data from the web, from HTTP libraries to browser automation tools and proxy services.
☆25Apr 6, 2025Updated last year
Alternatives and similar repositories for Awesome-Web-Scraping
Users that are interested in Awesome-Web-Scraping are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- bulk image downloader freeware, reddit bulk image downloader, bulk image downloader extension, bulk image downloader from url, bulk image…☆26Feb 19, 2026Updated 6 months ago
- Ideas, tricks, materials with puzzles for AIs and some wetware☆15Updated this week
- 🏛️ Direito Lux - SaaS para monitoramento automatizado de processos jurídicos com integração DataJud (CNJ)☆16Jul 18, 2025Updated last year
- Master Orchestrator for Gemini, Codex & Claude☆17Aug 27, 2025Updated last year
- Integrate Claude Code and Gemini CLI into your Obsidian workflow☆27May 28, 2026Updated 3 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Gradio UI to load crewAI configuration from excel xls and generate the python code. The source of the crews is in the xls. It allows for …☆10Oct 17, 2025Updated 10 months ago
- Agentset MCP Server - Build RAG with Agentic superpowers☆30Jun 16, 2025Updated last year
- Plivo github actions☆14Nov 29, 2022Updated 3 years ago
- Appscript to pull stats from gmail and store in a google sheet☆10Mar 20, 2021Updated 5 years ago
- Automated content cross posting from Notion Database to Dev.to, Hashnode, Medium, Twitter, and LinkedIn using GitHub Actions.☆14Oct 21, 2024Updated last year
- A MCP (Model Context Protocol) server for agent-driven research on Brazilian law using official sources☆35Jul 29, 2025Updated last year
- One command automated macOS/Linux laptop/VM/container bootstrapper.☆19Updated this week
- Automate the creation of high quality research papers in latex. Powered by Swarms 🤖☆11Dec 1, 2025Updated 8 months ago
- I saw this [Blog Post](https://www.morling.dev/blog/one-billion-row-challenge/) on a Billion Row challenge for Java so naturally I tried …☆14Jan 10, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code samples for Ingest data with Microsoft Fabric notebooks☆10Jul 21, 2023Updated 3 years ago
- Apps Script applications to connect Data Studio to external data sources☆13Sep 20, 2018Updated 7 years ago
- A collection of all the Google Data Studio Community Connectors that I've built over time.☆11Jun 17, 2022Updated 4 years ago
- Building a multi-agent RAG system with advanced RAG methods☆13Jan 12, 2025Updated last year
- ☆12Aug 1, 2026Updated 3 weeks ago
- A powerful Model Context Protocol (MCP) server that creates other MCP servers! This meta-server provides tools for dynamically generating…☆41Jun 18, 2025Updated last year
- Power Query Examples, with a bit of monkey business.☆11Oct 11, 2025Updated 10 months ago
- Custom tools for agent based crewAI langchain solutions☆10May 27, 2024Updated 2 years ago
- rUv-Engineer - let's you describe UI using your imagination, then see it rendered live.☆14Sep 28, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Real-Time Open-Vocabulary Object Detection☆12Feb 7, 2024Updated 2 years ago
- link archive for year 2024☆20May 7, 2025Updated last year
- Engaging visualisations, made easy.☆14Aug 7, 2024Updated 2 years ago
- Building a more intelligent world.☆11Apr 29, 2024Updated 2 years ago
- Machine Learning Data Fairness and Bias☆15Apr 29, 2026Updated 4 months ago
- Using Plotly to create a heatmap visualization of monthly and hourly data☆13Aug 9, 2021Updated 5 years ago
- These are my personal data analysis projects. I mainly used R/Python programming for my data analysis. And also used BI tools such as Tab…☆14Dec 12, 2025Updated 8 months ago
- Remote Model Context Protocol (MCP) server for Linear.☆16Apr 12, 2025Updated last year
- Use GPTparser with your OpenAI API to scrape & parse files into structured JSON files.☆13Apr 2, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Easily take an entire YouTube playlist and turn it into high quality transcripts using Whisper.☆10Feb 1, 2024Updated 2 years ago
- This is a python package that helps developers to generate fake social media profiles for development purposes☆12Oct 9, 2024Updated last year
- FinanceCrew is an AI-powered tool that helps day traders analyze markets, develop strategies, and manage risks using CrewAI.☆12Aug 9, 2024Updated 2 years ago
- 🧾 Let's automate Invoice generation from CSV file (@jakobowsky YouTube tutorial)☆12Sep 12, 2020Updated 5 years ago
- Romeo GPT is an AI assistant designed to provide a suite of services which range from document management and analysis to multifaceted AI…☆14Jun 12, 2023Updated 3 years ago
- OpenNyAI is a mission aimed at developing open source software and datasets to catalyze the creation of AI-powered solutions to improve a…☆10Nov 22, 2023Updated 2 years ago
- A simple to use package to call various model providers such as openai, anthropic, and others with utmost reliability, security, and perf…☆13Oct 6, 2025Updated 10 months ago