cassidoo / scrapers
A list of scrapers from around the web.
☆647Updated 5 months ago
Alternatives and similar repositories for scrapers:
Users that are interested in scrapers are comparing it to the libraries listed below
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆422Updated 2 years ago
- The Zipru scraper developed in the Advanced Web Scraping Tutorial.☆428Updated 7 years ago
- LinkedIn Scraper (currently working 2020)☆597Updated last year
- SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type …☆259Updated 2 years ago
- Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect …☆131Updated last year
- 🕊TwitPy - Follow/Unfollow Automation☆103Updated 4 years ago
- 🕷 🕸 crawl GitHub web pages for insights we can't GET from the API ... 💡☆435Updated this week
- Javascript scraping module based on puppeteer for many different search engines...☆551Updated 2 years ago
- 🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON.☆588Updated 9 months ago
- Social media scraping / data collection library for Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆569Updated 4 years ago
- Yellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.☆74Updated 4 years ago
- Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy☆824Updated this week
- Module for scraping LinkedIn profile contents☆59Updated 2 years ago
- Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs☆373Updated 6 years ago
- Crawler for LinkedIn full profiles 2019☆215Updated 4 years ago
- A curated list of SEO (Search Engine Optimization) links.☆674Updated 2 months ago
- A collection of awesome web scaper, crawler.☆264Updated 9 months ago
- A Python scraper for the Facebook Ad Library, using the official Facebook Ad Library API.☆118Updated 5 years ago
- An unofficial API for Quora.☆295Updated 8 years ago
- A Curated Collection of the Best Twitter Bots 🤖☆112Updated 5 years ago
- Fetch user's data across social media☆458Updated 6 months ago
- A curated list of awesome twitter tools☆215Updated last year
- use multiple proxies with Scrapy☆749Updated 2 years ago
- A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.☆2,658Updated 3 years ago
- Yet another multi language scraper for Amazon targeting reviews.☆124Updated 2 months ago
- Lots and lots of web scrapers☆179Updated 3 years ago
- Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSO…☆150Updated last year
- A step-by-step guide to writing a web scraper with Python☆208Updated 2 weeks ago
- A Twitter bot written in Python to replace yourself, search and publish news about specific subjects on Twitter. PyTweetBot use Machine L…☆102Updated 6 years ago
- `scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into struct…☆474Updated 2 years ago