A list of scrapers from around the web.
☆720Feb 7, 2025Updated last year
Alternatives and similar repositories for scrapers
Users that are interested in scrapers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A collection of awesome web scaper, crawler.☆288Apr 4, 2024Updated 2 years ago
- A collection of awesome web crawler,spider in different languages☆7,195Jun 16, 2024Updated last year
- List of libraries, tools and APIs for web scraping and data processing.☆7,902Apr 17, 2026Updated last month
- A Smart, Automatic, Fast and Lightweight Web Scraper for Python☆7,173Jun 9, 2025Updated 11 months ago
- A quick webapp that determines if a picture is a chihuahua or a muffin.☆12Apr 16, 2016Updated 10 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Lots and lots of web scrapers☆183Aug 31, 2021Updated 4 years ago
- Fetch user's data across social media☆550Mar 1, 2026Updated 2 months ago
- Watch your Snapchats arrive live in the browser☆26Oct 3, 2014Updated 11 years ago
- 🕷 🕸 crawl GitHub web pages for insights we can't GET from the API ... 💡☆456May 8, 2026Updated last week
- A javascript app to show your google location history as a heatmap☆22May 10, 2015Updated 11 years ago
- A collection of awesome lists, tools, frameworks, libraries, software and resources.☆13Nov 9, 2018Updated 7 years ago
- A pure-python HTML screen-scraping library☆1,889Apr 4, 2022Updated 4 years ago
- A complete and versatile web scraper.☆3,720Oct 18, 2020Updated 5 years ago
- Friendly web crawler for x-ray☆44Jan 23, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Curated list of technologies for your next startup☆48Apr 3, 2023Updated 3 years ago
- Web Scraping Framework☆2,459Sep 19, 2025Updated 8 months ago
- Search google, bing, yahoo, and other search engines with python☆670Apr 2, 2025Updated last year
- Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆393Jan 5, 2019Updated 7 years ago
- A demo of LaunchDarkly, React, and Vite, using the Pokémon API!☆16May 18, 2021Updated 5 years ago
- Awesome Forums☆36Jun 24, 2020Updated 5 years ago
- A simple script to take screenshots of websites using Selenium webdriver☆13Jan 6, 2019Updated 7 years ago
- Docker container for Shiny Server☆14Mar 31, 2016Updated 10 years ago
- next generation web crawling using machine intelligence☆332Aug 14, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A command line utility for Slack☆10Mar 17, 2016Updated 10 years ago
- A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.☆2,812Jul 3, 2021Updated 4 years ago
- My personal website☆15Oct 27, 2015Updated 10 years ago
- An open-source Claude 3 prompt optimizer☆14Nov 25, 2024Updated last year
- Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Tre…☆880Feb 1, 2022Updated 4 years ago
- A project to extract Phone number information from online sources. Extracted information is exposed on different online sources.☆19Sep 11, 2020Updated 5 years ago
- Disclaimer: These are actions and applications I believe to be the best for setting up an optimal development environment are extensions …☆21Mar 8, 2015Updated 11 years ago
- Basic example using Clarifai custom training.☆10Oct 17, 2015Updated 10 years ago
- 🤖 Top-rated tools to scrape all major public sections from Facebook, Instagram, and Twitter (X) including posts (likes/comments), photos…☆3,115Jun 7, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- list of awesome-articles☆17Jul 15, 2021Updated 4 years ago
- Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data …☆23,308Updated this week
- Python 3.6 Module to Profile Function Performance in Production☆17Feb 19, 2017Updated 9 years ago
- Curated list of all dataset websites that I find☆83Oct 17, 2018Updated 7 years ago
- An introduction to free, automated web scraping with GitHub’s powerful new Actions framework.☆31Aug 19, 2024Updated last year
- A dashboard that show the relationships between urban spaces and their networks of design, production and consumption with Maker initiati…☆14Nov 10, 2017Updated 8 years ago
- Javascript scraping module based on puppeteer for many different search engines...☆569Dec 30, 2022Updated 3 years ago