comp-strat / web_scraping
Code and data for the research team scraping charter websites using scrapy, requests, Selenium, and wget with Python, shell, and Docker. This is the foundation of analyses into charter schools' linguistic strategies and social implications.
☆12Updated 2 years ago
Alternatives and similar repositories for web_scraping:
Users that are interested in web_scraping are comparing it to the libraries listed below
- Zyte Automatic Extraction integration for Scrapy☆56Updated 3 years ago
- Python clients for Zyte AutoExtract API☆40Updated 3 years ago
- Parametrize and run scripts as notebooks with jupytext and papermill☆17Updated 5 years ago
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆75Updated 3 years ago
- Python bindings for Upwork API (OAuth2)☆40Updated 5 months ago
- Python Scrapy spider that scrapes all Amazon products from a keyword search☆86Updated 2 years ago
- Spider templates for automatic crawlers.☆29Updated last week
- Web scraping Page Objects core library☆99Updated 2 months ago
- Simple job postings scraper for Indeed based on requests and BeautifulSoup☆14Updated 3 years ago
- Scrapers from a project in 2018. Yelp, Spyfu, Similarweb, Morningstar, Linkedin, Instagram, Inside, Glassdoor, Facebook, Eat24, Doordash,…☆95Updated 6 years ago
- Google trends is to examine trending google searches on geographical location and across time for input keywords.☆40Updated last year
- Scraping of LinkedIn Profiles: Creates an Excel file containing the personal data and the last job position of all the provided LinkedIn …☆121Updated last year
- ☆15Updated 6 years ago
- Kryptos AI is a virtual investment assistant that manages your cryptocurrency portfolio☆49Updated 4 years ago
- Pluggable DSL that uses pipes to perform a series of linear transformations to extract data☆16Updated 9 months ago
- 🤩 Python Package for Scraping Amazon Product Reviews ✨☆36Updated 2 years ago
- Module for scraping LinkedIn profile contents☆60Updated 2 years ago
- JavaScript support and proxy rotation for Scrapy with ScrapingBee.☆38Updated 11 months ago
- Get the estimated value of a property from Redfin and Zillow☆23Updated 3 weeks ago
- Common interface for data container classes☆67Updated last month
- Scraper for extracting data from Google Trends☆15Updated 3 years ago
- Google data studio connector that fetches data from api endpoint☆12Updated 4 years ago
- Socialytics is a social network data acquisition (ETL), analytics and intelligence tool.☆9Updated 5 years ago
- All-in-one Web Scrapper for Python☆61Updated 2 years ago
- Simple dashboard for getting currently trending hashtags and topics on Twitter☆25Updated 2 years ago
- A Python wrapper for Indeed Job Search API☆14Updated 6 years ago
- This is a python program which scrapes linkedin information upto 98% accuracy using the google custom search API. It also uses pandas to …☆24Updated 8 years ago
- A Python scraper for the Facebook Ad Library, using the official Facebook Ad Library API.☆119Updated 5 years ago
- The Selenium scraper that collected a million stories from Medium.com☆80Updated 6 years ago
- Zyte API integration for Scrapy☆38Updated 3 weeks ago