cassidoo / scrapers
A list of scrapers from around the web.
☆625Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for scrapers
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆415Updated last year
- The Zipru scraper developed in the Advanced Web Scraping Tutorial.☆426Updated 7 years ago
- SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type …☆257Updated 2 years ago
- A collection of awesome web scaper, crawler.☆254Updated 7 months ago
- A look at how LinkedIn spies on its users.☆824Updated 5 years ago
- 🕷 🕸 crawl GitHub web pages for insights we can't GET from the API ... 💡☆433Updated last week
- Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy☆782Updated this week
- Crawler for LinkedIn full profiles 2019☆215Updated 4 years ago
- Scrapy spiders of major websites. Google Play Store, Facebook, Instagram, Ebay, YTS Movies, Amazon☆282Updated 7 years ago
- Javascript scraping module based on puppeteer for many different search engines...☆548Updated last year
- Awesome Links about bots.☆447Updated 6 years ago
- Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect …☆129Updated last year
- Python distributed web scrapper and dynamic crawler☆140Updated 7 years ago
- Scrapes the public profile of the linkedin page☆554Updated 7 months ago
- Extract embedded metadata from HTML markup☆853Updated last week
- Take the hassle out of web scraping☆461Updated last year
- Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSO…☆150Updated last year
- use multiple proxies with Scrapy☆739Updated 2 years ago
- HTTP API for Scrapy spiders☆835Updated 4 months ago
- A curated list of SEO (Search Engine Optimization) links.☆664Updated last week
- Scraper that searches Google based on a query and scrapes all emails found on each page.☆103Updated 5 years ago
- Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆367Updated 5 years ago
- A Python script that parses post titles, self-texts, and comments on reddit and makes word clouds out of the word frequencies.☆286Updated last year
- next generation web crawling using machine intelligence☆329Updated last year
- An unofficial API for Quora.☆295Updated 8 years ago
- Desktop and web app for Instagram analytics in under 10 seconds. 🚀 https://preethamvishy.github.io/socialytics☆97Updated 4 years ago
- SEO: Python script + shell script and cronjob to check ranks on a daily basis☆268Updated 10 months ago
- Scrape the Instagram frontend. Inspired from twitter-scraper by @kennethreitz.☆937Updated 6 years ago
- Awesome Chrome Extensions☆428Updated 3 weeks ago
- LinkedIn Scraper (currently working 2020)☆598Updated last year