cassidoo / scrapersLinks
A list of scrapers from around the web.
☆674Updated 4 months ago
Alternatives and similar repositories for scrapers
Users that are interested in scrapers are comparing it to the libraries listed below
Sorting:
- 🕷 🕸 crawl GitHub web pages for insights we can't GET from the API ... 💡☆448Updated last week
- next generation web crawling using machine intelligence☆330Updated last year
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆430Updated 2 years ago
- A look at how LinkedIn spies on its users.☆832Updated 6 years ago
- Websites crawler with built-in exploration and control web interface☆354Updated this week
- A collection of awesome web scaper, crawler.☆272Updated last year
- Javascript scraping module based on puppeteer for many different search engines...☆561Updated 2 years ago
- Web data extraction tool implemented as chrome extension☆1,334Updated 6 years ago
- Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆385Updated 6 years ago
- The Zipru scraper developed in the Advanced Web Scraping Tutorial.☆429Updated 8 years ago
- Simple web scraping for Google Chrome.☆347Updated 14 years ago
- This is a dataset of the all-time top 1,000 posts, from the top 2,500 subreddits by subscribers, pulled from reddit between August 15–20,…☆621Updated 5 years ago
- Cloud crawler functions for scrapeulous☆45Updated 4 years ago
- SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type …☆264Updated 2 years ago
- Scraper that searches Google based on a query and scrapes all emails found on each page.☆106Updated 6 years ago
- Social media scraping / data collection library for Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆606Updated 5 years ago
- A curated list of resources related to internet marketing.☆218Updated 3 weeks ago
- 🕊TwitPy - Follow/Unfollow Automation☆105Updated 4 years ago
- Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy☆912Updated this week
- Crawler for LinkedIn full profiles 2019☆215Updated 4 years ago
- A list of memex-related tools and their repository URLs☆151Updated 7 years ago
- Take the hassle out of web scraping☆467Updated 2 years ago
- Download YouTube video description and video comments without using the YouTube API.☆167Updated last year
- The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns☆1,492Updated last month
- use multiple proxies with Scrapy☆762Updated 3 years ago
- Lots and lots of web scrapers☆181Updated 3 years ago
- A curated list of backlink, social signal opportunities, link building strategies and tactics, along with educational opportunities to he…☆234Updated last month
- Data scraper for Facebook Pages, and also code accompanying the blog post How to Scrape Data From Facebook Page Posts for Statistical Ana…☆2,124Updated 6 years ago
- brozzler - distributed browser-based web crawler☆720Updated 2 weeks ago
- Scrapes public information off of LinkedIn☆110Updated 9 years ago