A list of scrapers from around the web.
☆725Feb 7, 2025Updated last year
Alternatives and similar repositories for scrapers
Users that are interested in scrapers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A collection of awesome web scaper, crawler.☆291Apr 4, 2024Updated 2 years ago
- A collection of awesome web crawler,spider in different languages☆7,239Jun 16, 2024Updated 2 years ago
- List of libraries, tools and APIs for web scraping and data processing.☆7,948May 28, 2026Updated last month
- A Smart, Automatic, Fast and Lightweight Web Scraper for Python☆7,297Jun 9, 2025Updated last year
- A quick webapp that determines if a picture is a chihuahua or a muffin.☆12Apr 16, 2016Updated 10 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Lots and lots of web scrapers☆182Aug 31, 2021Updated 4 years ago
- Collection of Hackathon Resources.☆26Dec 16, 2015Updated 10 years ago
- Web scraper with a simple REST API living in Docker and using a Headless browser and Readability.js for parsing.☆321Apr 11, 2025Updated last year
- 🕷 🕸 crawl GitHub web pages for insights we can't GET from the API ... 💡☆455Jun 22, 2026Updated last week
- Tellonym scraper and information gathering tool. Might be useful for getting background-info on a person, etc. 🔍☆14Dec 8, 2022Updated 3 years ago
- A club of Ideas, feedbacks and resources☆10Dec 9, 2021Updated 4 years ago
- A Chrome extension to search Trip Advisor by image with Clarifai☆31Jul 14, 2016Updated 9 years ago
- A python script that looks for special lines in a markdown file and uses those lines to convert, clean up, and insert content from URLs i…☆16Dec 9, 2012Updated 13 years ago
- Friendly web crawler for x-ray☆44Jan 23, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Web Scraping Framework☆2,462Sep 19, 2025Updated 9 months ago
- Search google, bing, yahoo, and other search engines with python☆669Apr 2, 2025Updated last year
- Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆398Jan 5, 2019Updated 7 years ago
- Download website to local directory (including all css, images, js, etc.)☆1,734Jun 22, 2026Updated last week
- Visual scraping for Scrapy☆9,506Jun 26, 2024Updated 2 years ago
- Somewhere to store stuff relating to my work on Multi-column layout☆11Aug 11, 2017Updated 8 years ago
- Save My News: A personal, permanent clipping service☆29Oct 7, 2023Updated 2 years ago
- Downloads TikToks for users without water marks☆22Nov 9, 2025Updated 7 months ago
- تطبيق صلي علي محمد وذكر الله☆13Jun 13, 2021Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- 🔮 A Node.js scraper for humans.☆4,073Oct 13, 2025Updated 8 months ago
- ☆13Updated this week
- Docker container for Shiny Server☆14Mar 31, 2016Updated 10 years ago
- next generation web crawling using machine intelligence☆332Aug 14, 2023Updated 2 years ago
- A command line utility for Slack☆10Mar 17, 2016Updated 10 years ago
- A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.☆2,824Jul 3, 2021Updated 4 years ago
- Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Tre…☆887Feb 1, 2022Updated 4 years ago
- ☆35May 30, 2020Updated 6 years ago
- A project to extract Phone number information from online sources. Extracted information is exposed on different online sources.☆19Sep 11, 2020Updated 5 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Go robots.txt parser☆15Nov 27, 2017Updated 8 years ago
- Convert images to audio, visible with a spectrograph. Uses Inverse Fast Fourier Transform.☆19May 15, 2015Updated 11 years ago
- A library for Spatially-Explicit Regionalization☆15Feb 7, 2020Updated 6 years ago
- Disclaimer: These are actions and applications I believe to be the best for setting up an optimal development environment are extensions …☆21Mar 8, 2015Updated 11 years ago
- 🤖 Top-rated tools to scrape all major public sections from Facebook, Instagram, and Twitter (X) including posts (likes/comments), photos…☆3,132Jun 7, 2025Updated last year
- list of awesome-articles☆17Jul 15, 2021Updated 4 years ago
- Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data …☆24,227Updated this week