A list of scrapers from around the web.
☆724Feb 7, 2025Updated last year
Alternatives and similar repositories for scrapers
Users that are interested in scrapers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A collection of awesome web scaper, crawler.☆289Apr 4, 2024Updated 2 years ago
- List of libraries, tools and APIs for web scraping and data processing.☆7,919May 28, 2026Updated last week
- A Smart, Automatic, Fast and Lightweight Web Scraper for Python☆7,178Jun 9, 2025Updated last year
- Lots and lots of web scrapers☆183Aug 31, 2021Updated 4 years ago
- Fetch user's data across social media☆555Jun 2, 2026Updated last week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Analytics for the real world.☆11Oct 15, 2015Updated 10 years ago
- 🕷 🕸 crawl GitHub web pages for insights we can't GET from the API ... 💡☆456May 8, 2026Updated last month
- A club of Ideas, feedbacks and resources☆10Dec 9, 2021Updated 4 years ago
- Tellonym scraper and information gathering tool. Might be useful for getting background-info on a person, etc. 🔍☆14Dec 8, 2022Updated 3 years ago
- A collection of awesome lists, tools, frameworks, libraries, software and resources.☆13Nov 9, 2018Updated 7 years ago
- A pure-python HTML screen-scraping library☆1,889Apr 4, 2022Updated 4 years ago
- A complete and versatile web scraper.☆3,722Oct 18, 2020Updated 5 years ago
- Friendly web crawler for x-ray☆44Jan 23, 2023Updated 3 years ago
- Web Scraping Framework☆2,460Sep 19, 2025Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆396Jan 5, 2019Updated 7 years ago
- Github project kanban board minimal visualization for big screen projection☆14Jan 9, 2019Updated 7 years ago
- Awesome Forums☆36Jun 24, 2020Updated 5 years ago
- Visual scraping for Scrapy☆9,505Jun 26, 2024Updated last year
- Somewhere to store stuff relating to my work on Multi-column layout☆11Aug 11, 2017Updated 8 years ago
- Save My News: A personal, permanent clipping service☆29Oct 7, 2023Updated 2 years ago
- Downloads TikToks for users without water marks☆22Nov 9, 2025Updated 7 months ago
- 🔮 A Node.js scraper for humans.☆4,076Oct 13, 2025Updated 7 months ago
- next generation web crawling using machine intelligence☆332Aug 14, 2023Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.☆2,820Jul 3, 2021Updated 4 years ago
- Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Tre…☆880Feb 1, 2022Updated 4 years ago
- An open-source Claude 3 prompt optimizer☆14Nov 25, 2024Updated last year
- ☆36Nov 7, 2023Updated 2 years ago
- 🚲🔍A app to search for shared bike stations in the chosen city☆13May 2, 2018Updated 8 years ago
- A project to extract Phone number information from online sources. Extracted information is exposed on different online sources.☆19Sep 11, 2020Updated 5 years ago
- Parse content from nsfw.xxx☆20Jan 3, 2024Updated 2 years ago
- 🤖 Top-rated tools to scrape all major public sections from Facebook, Instagram, and Twitter (X) including posts (likes/comments), photos…☆3,124Jun 7, 2025Updated last year
- list of awesome-articles☆17Jul 15, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An introduction to free, automated web scraping with GitHub’s powerful new Actions framework.☆31Aug 19, 2024Updated last year
- Javascript scraping module based on puppeteer for many different search engines...☆569Dec 30, 2022Updated 3 years ago
- The next web scraper. See through the <html> noise.☆5,906May 6, 2026Updated last month
- Easy interactive prompts to create and validate data using JSON schema.☆11Apr 9, 2026Updated 2 months ago
- Fake Seeder for Torrent☆13May 3, 2020Updated 6 years ago
- Uberdoc is a wrapper script for pandoc which provides a build system for large documents☆23Nov 22, 2013Updated 12 years ago
- Get public Notion page's data.☆16Jun 25, 2022Updated 3 years ago