stummjr / books_crawlerLinks
A Scrapy crawler for http://books.toscrape.com
☆27Updated 8 years ago
Alternatives and similar repositories for books_crawler
Users that are interested in books_crawler are comparing it to the libraries listed below
Sorting:
- Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords☆45Updated last year
- Simple Web UI for Scrapy spider management via Scrapyd☆51Updated 7 years ago
- sync a website or local spreadsheet with a google sheet☆35Updated 2 years ago
- Decentralized web archiving☆20Updated 6 years ago
- A sample project for Netlify CMS + Nikola that can be deployed in one click.☆18Updated 3 weeks ago
- A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.☆109Updated last year
- Personal Knowledge Management System. Capture your ideas using plain old text files. Make a journal that lasts 100 years.☆29Updated last year
- Search, download, convert and send files directly to your kindle from Libgen in one place.☆24Updated 2 years ago
- A modular template for scraping data from the web to send yourself scheduled email reports☆41Updated 5 years ago
- A python instagram scraper which uses BeautifulSoup and JSON to scrape public instagram accounts☆27Updated 7 years ago
- A list of awesome project for Ruia☆13Updated 2 years ago
- Python tool for automatic data scraping from Html templates☆19Updated 9 years ago
- A Python library to load structured table data from files/strings/URL with various data format: CSV / Excel / Google-Sheets / HTML / JSON…☆108Updated 2 years ago
- A Python script to help you add user attributions to your Twitter bots☆12Updated 5 years ago
- A boilerplate Python 3 project☆20Updated this week
- A scrapy spider to extract post, thread, and user information from a vBulletin forum to a MongoDB database.☆32Updated 9 years ago
- Awesome Stack Exchange Communities☆27Updated 5 years ago
- Official Python package for ArchiveBox, the self-hosted internet archiving solution.☆13Updated 9 months ago
- Scrapy middleware which allows to crawl only new content☆80Updated 2 years ago
- ☆15Updated 3 years ago
- Crawler and scraper of the public directory of companies on LinkedIn.☆25Updated 6 years ago
- A simple Web crawler for stackshare.io using scrapy .☆9Updated 6 years ago
- Automatically follow a ton of people on Poshmark.☆12Updated 9 years ago
- Scraping Assisted by Learning☆35Updated last month
- Date parsing and normalization utilities for Python.☆22Updated last year
- A scrapy extension to store requests and responses information in storage service☆26Updated 3 years ago
- TWINT Graph Visualizer☆80Updated 6 years ago
- 👨👩👦 Social account detection and extraction in Python, e.g. for crawling/scraping.☆47Updated 2 years ago
- Download porn videos (Python)☆12Updated 7 years ago
- Downloads all PDFs on a webpage (for lazy people)☆23Updated 3 years ago