A list of scrapers from around the web.
☆721Feb 7, 2025Updated last year
Alternatives and similar repositories for scrapers
Users that are interested in scrapers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A collection of awesome web scaper, crawler.☆285Apr 4, 2024Updated 2 years ago
- A collection of awesome web crawler,spider in different languages☆7,183Jun 16, 2024Updated last year
- List of libraries, tools and APIs for web scraping and data processing.☆7,855Apr 17, 2026Updated last week
- A Smart, Automatic, Fast and Lightweight Web Scraper for Python☆7,143Jun 9, 2025Updated 10 months ago
- A quick webapp that determines if a picture is a chihuahua or a muffin.☆12Apr 16, 2016Updated 10 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Lots and lots of web scrapers☆183Aug 31, 2021Updated 4 years ago
- Talks at conferences, meetups, hackathons, and more, plus my speaker rider for good measure.☆705Updated this week
- Watch your Snapchats arrive live in the browser☆26Oct 3, 2014Updated 11 years ago
- Collection of Hackathon Resources.☆26Dec 16, 2015Updated 10 years ago
- Web scraper with a simple REST API living in Docker and using a Headless browser and Readability.js for parsing.☆314Apr 11, 2025Updated last year
- 🕷 🕸 crawl GitHub web pages for insights we can't GET from the API ... 💡☆455Apr 9, 2026Updated 3 weeks ago
- My personal website!☆12Jun 9, 2016Updated 9 years ago
- A pure-python HTML screen-scraping library☆1,887Apr 4, 2022Updated 4 years ago
- A python script that looks for special lines in a markdown file and uses those lines to convert, clean up, and insert content from URLs i…☆16Dec 9, 2012Updated 13 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A complete and versatile web scraper.☆3,718Oct 18, 2020Updated 5 years ago
- Curated list of technologies for your next startup☆48Apr 3, 2023Updated 3 years ago
- Search google, bing, yahoo, and other search engines with python☆667Apr 2, 2025Updated last year
- Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆393Jan 5, 2019Updated 7 years ago
- adds Gmail labels to IMAP stream as the X-Label header☆20Oct 10, 2021Updated 4 years ago
- Github project kanban board minimal visualization for big screen projection☆14Jan 9, 2019Updated 7 years ago
- Awesome Forums☆36Jun 24, 2020Updated 5 years ago
- Download website to local directory (including all css, images, js, etc.)☆1,713Apr 20, 2026Updated last week
- Visual scraping for Scrapy☆9,494Jun 26, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Downloads TikToks for users without water marks☆22Nov 9, 2025Updated 5 months ago
- Save My News: A personal, permanent clipping service☆29Oct 7, 2023Updated 2 years ago
- cloud.webscraper.io API client☆12Jan 27, 2026Updated 3 months ago
- تطبيق صلي علي محمد وذكر الله☆13Jun 13, 2021Updated 4 years ago
- 🔮 A Node.js scraper for humans.☆4,072Oct 13, 2025Updated 6 months ago
- next generation web crawling using machine intelligence☆332Aug 14, 2023Updated 2 years ago
- Guide for getting a gig as a tech student.☆7,641Apr 21, 2025Updated last year
- A command line utility for Slack☆10Mar 17, 2016Updated 10 years ago
- A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.☆2,802Jul 3, 2021Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- المصدر البرمجي لمتجر عربي☆11Jun 29, 2016Updated 9 years ago
- My personal website☆15Oct 27, 2015Updated 10 years ago
- Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Tre…☆876Feb 1, 2022Updated 4 years ago
- An open-source Claude 3 prompt optimizer☆14Nov 25, 2024Updated last year
- A collection of random scripts I coded up☆17May 10, 2018Updated 7 years ago
- Parse content from nsfw.xxx☆20Jan 3, 2024Updated 2 years ago
- 🤖 Top-rated tools to scrape all major public sections from Facebook, Instagram, and Twitter (X) including posts (likes/comments), photos…☆3,106Jun 7, 2025Updated 10 months ago