A list of libraries, tools, and APIs for web scraping and data processing. Find everything you need for extracting, managing, and processing data from the web, from HTTP libraries to browser automation tools and proxy services.
☆23Apr 6, 2025Updated last year
Alternatives and similar repositories for Awesome-Web-Scraping
Users that are interested in Awesome-Web-Scraping are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- bulk image downloader freeware, reddit bulk image downloader, bulk image downloader extension, bulk image downloader from url, bulk image…☆26Feb 19, 2026Updated 5 months ago
- AI Reddit bot that scrapes subreddits for questions, conducts research, and posts automated answers to help users with relevant informati…☆22Sep 13, 2024Updated last year
- A swarm of LLM agents that will help you test, document, and productionize your code!☆20Aug 3, 2026Updated last week
- Harness Engineering control plane for agent-first software delivery. Orchestrate Claude Code, Codex, OpenCode, and shell-native agents vi…☆19Updated this week
- ☆17Jul 12, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Task management for AI agents☆17Jun 25, 2025Updated last year
- Gradio UI to load crewAI configuration from excel xls and generate the python code. The source of the crews is in the xls. It allows for …☆10Oct 17, 2025Updated 9 months ago
- Plivo github actions☆14Nov 29, 2022Updated 3 years ago
- Appscript to pull stats from gmail and store in a google sheet☆10Mar 20, 2021Updated 5 years ago
- Automated content cross posting from Notion Database to Dev.to, Hashnode, Medium, Twitter, and LinkedIn using GitHub Actions.☆14Oct 21, 2024Updated last year
- ☆12Mar 20, 2023Updated 3 years ago
- One command automated macOS/Linux laptop/VM/container bootstrapper.☆19Updated this week
- ☆11Feb 17, 2022Updated 4 years ago
- Automate the creation of high quality research papers in latex. Powered by Swarms 🤖☆11Dec 1, 2025Updated 8 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- https://www.fededirectory.frb.org/FedACHdir.txt☆11Oct 30, 2018Updated 7 years ago
- Apps Script applications to connect Data Studio to external data sources☆13Sep 20, 2018Updated 7 years ago
- A collection of all the Google Data Studio Community Connectors that I've built over time.☆11Jun 17, 2022Updated 4 years ago
- Building a multi-agent RAG system with advanced RAG methods☆13Jan 12, 2025Updated last year
- Custom tools for agent based crewAI langchain solutions☆10May 27, 2024Updated 2 years ago
- rUv-Engineer - let's you describe UI using your imagination, then see it rendered live.☆14Sep 28, 2024Updated last year
- Real-Time Open-Vocabulary Object Detection☆12Feb 7, 2024Updated 2 years ago
- link archive for year 2024☆20May 7, 2025Updated last year
- Demo App☆11Jan 27, 2026Updated 6 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Auto-generated sphinx version of the IPython website. Since this is an auto-generated directory, do *not* submit pull requests against th…☆11Jun 2, 2026Updated 2 months ago
- Engaging visualisations, made easy.☆14Aug 7, 2024Updated 2 years ago
- Machine Learning Data Fairness and Bias☆15Apr 29, 2026Updated 3 months ago
- Using Plotly to create a heatmap visualization of monthly and hourly data☆13Aug 9, 2021Updated 5 years ago
- These are my personal data analysis projects. I mainly used R/Python programming for my data analysis. And also used BI tools such as Tab…☆14Dec 12, 2025Updated 7 months ago
- ☆15Apr 18, 2024Updated 2 years ago
- Remote Model Context Protocol (MCP) server for Linear.☆16Apr 12, 2025Updated last year
- AI-powered cryptocurrency trading bot built using deep reinforcement learning (DRL). The bot is designed as a research platform for devel…☆11Jan 18, 2025Updated last year
- Use GPTparser with your OpenAI API to scrape & parse files into structured JSON files.☆13Apr 2, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Easily take an entire YouTube playlist and turn it into high quality transcripts using Whisper.☆10Feb 1, 2024Updated 2 years ago
- This is a python package that helps developers to generate fake social media profiles for development purposes☆12Oct 9, 2024Updated last year
- FinanceCrew is an AI-powered tool that helps day traders analyze markets, develop strategies, and manage risks using CrewAI.☆12Aug 9, 2024Updated 2 years ago
- 🧾 Let's automate Invoice generation from CSV file (@jakobowsky YouTube tutorial)☆12Sep 12, 2020Updated 5 years ago
- Romeo GPT is an AI assistant designed to provide a suite of services which range from document management and analysis to multifaceted AI…☆14Jun 12, 2023Updated 3 years ago
- Instagram Automation Tool is a framework that automates various Instagram tasks, including file-based operations and web automation (via …☆16May 4, 2025Updated last year
- ☆13Updated this week