A list of scrapers from around the web.
☆713Feb 7, 2025Updated last year
Alternatives and similar repositories for scrapers
Users that are interested in scrapers are comparing it to the libraries listed below
Sorting:
- A collection of awesome web scaper, crawler.☆284Apr 4, 2024Updated last year
- List of libraries, tools and APIs for web scraping and data processing.☆7,798Updated this week
- A collection of awesome web crawler,spider in different languages☆7,137Jun 16, 2024Updated last year
- A Smart, Automatic, Fast and Lightweight Web Scraper for Python☆7,110Jun 9, 2025Updated 9 months ago
- Fetch user's data across social media☆516Mar 1, 2026Updated last week
- Lots and lots of web scrapers☆185Aug 31, 2021Updated 4 years ago
- Watch your Snapchats arrive live in the browser☆25Oct 3, 2014Updated 11 years ago
- A club of Ideas, feedbacks and resources☆10Dec 9, 2021Updated 4 years ago
- 🕷 🕸 crawl GitHub web pages for insights we can't GET from the API ... 💡☆455Jan 27, 2026Updated last month
- A command line utility for Slack☆10Mar 17, 2016Updated 9 years ago
- An open-source Claude 3 prompt optimizer☆14Nov 25, 2024Updated last year
- A pure-python HTML screen-scraping library☆1,886Apr 4, 2022Updated 3 years ago
- Visual scraping for Scrapy☆9,496Jun 26, 2024Updated last year
- A complete and versatile web scraper.☆3,720Oct 18, 2020Updated 5 years ago
- Collection of Hackathon Resources.☆26Dec 16, 2015Updated 10 years ago
- Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Tre…☆865Feb 1, 2022Updated 4 years ago
- A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.☆2,797Jul 3, 2021Updated 4 years ago
- Web Scraping Framework☆2,457Sep 19, 2025Updated 5 months ago
- Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆392Jan 5, 2019Updated 7 years ago
- Awesome Forums☆36Jun 24, 2020Updated 5 years ago
- 🤖 Top-rated tools to scrape all major public sections from Facebook, Instagram, and Twitter (X) including posts (likes/comments), photos…☆3,093Jun 7, 2025Updated 9 months ago
- Get public Notion page's data.☆15Jun 25, 2022Updated 3 years ago
- ☆32May 30, 2020Updated 5 years ago
- Beginners' tutorial on how to extract information from databases with SQL☆22Aug 29, 2017Updated 8 years ago
- Scrapy downloader middleware that stores response HTMLs to disk.☆18Jan 14, 2026Updated last month
- next generation web crawling using machine intelligence☆332Aug 14, 2023Updated 2 years ago
- URL fingerprinting made easy☆89Apr 13, 2024Updated last year
- Social media scraping / data collection library for Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆637Jun 25, 2020Updated 5 years ago
- ☆11Jan 5, 2023Updated 3 years ago
- Centralize, view, edit, label and organize collections of your favorite URLs 🔗 📙☆39Nov 25, 2022Updated 3 years ago
- Basic example using Clarifai custom training.☆10Oct 17, 2015Updated 10 years ago
- A Chrome extension to search Trip Advisor by image with Clarifai☆31Jul 14, 2016Updated 9 years ago
- My personal website☆15Oct 27, 2015Updated 10 years ago
- A continuously curated list of my favorite links and resources relating to Open Source Intelligence gathering.☆18Jul 10, 2018Updated 7 years ago
- A collection of scripts for Google Apps Scripts☆56Dec 1, 2021Updated 4 years ago
- Search google, bing, yahoo, and other search engines with python☆670Apr 2, 2025Updated 11 months ago
- Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data …☆22,013Updated this week
- Convert images to audio, visible with a spectrograph. Uses Inverse Fast Fourier Transform.☆19May 15, 2015Updated 10 years ago
- ALife simulation with Python: patterns, behavior, and cognition.☆22Aug 18, 2020Updated 5 years ago