cassidoo / scrapers
A list of scrapers from around the web.
☆660Updated last month
Alternatives and similar repositories for scrapers:
Users that are interested in scrapers are comparing it to the libraries listed below
- Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy☆861Updated this week
- Scrape the Instagram frontend. Inspired from twitter-scraper by @kennethreitz.☆942Updated 6 years ago
- Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆381Updated 6 years ago
- 🕷 🕸 crawl GitHub web pages for insights we can't GET from the API ... 💡☆444Updated 2 months ago
- SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type …☆260Updated 2 years ago
- Simple web scraping for Google Chrome.☆343Updated 14 years ago
- ☆679Updated last year
- Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt☆81Updated last year
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆427Updated 2 years ago
- Scrapy spiders of major websites. Google Play Store, Facebook, Instagram, Ebay, YTS Movies, Amazon☆285Updated 7 years ago
- SEO: Python script + shell script and cronjob to check ranks on a daily basis☆281Updated last year
- Scrape Instagram's API with Puppeteer☆402Updated 2 years ago
- next generation web crawling using machine intelligence☆331Updated last year
- Scrapes the public profile of the linkedin page☆556Updated 11 months ago
- Javascript scraping module based on puppeteer for many different search engines...☆558Updated 2 years ago
- Job scraper and applier for indeed.com☆375Updated 3 years ago
- Scrapes public information off of LinkedIn☆110Updated 9 years ago
- Social media research and promotion, semi-autonomous CLI bot☆145Updated 5 years ago
- A curated list of awesome packages, articles, and other cool resources from the Scrapy community.☆546Updated 2 years ago
- The Keyword Volume Tool uses the Google Adwords API Targeting Ideas Service to return the search volume and competition of a massive list…☆152Updated 8 years ago
- An unofficial API for Quora.☆297Updated 8 years ago
- A LinkedIn Scraper to scrape up to 1k LinkedIn profiles(due to LinkedIn limit) from company profile links and save their e-mail addresses…☆226Updated 5 months ago
- A curated list of resources related to internet marketing.☆215Updated 5 months ago
- Awesome Links about bots.☆447Updated 6 years ago
- `scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into struct…☆480Updated 2 years ago
- ☆56Updated 4 years ago
- 🕊TwitPy - Follow/Unfollow Automation☆104Updated 4 years ago
- A curated list of awesome twitter tools☆221Updated last year
- A curated list of backlink, social signal opportunities, link building strategies and tactics, along with educational opportunities to he…☆222Updated last week
- Linkedin crawler to search and collect user data☆52Updated 6 years ago