Scrapy examples crawling Craigslist
☆199Apr 20, 2016Updated 10 years ago
Alternatives and similar repositories for Scrapy-Samples
Users that are interested in Scrapy-Samples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Send text when a new Craigslist posting matches a given keyword or phrase☆95Jan 1, 2015Updated 11 years ago
- Some scrapy and web.py exmaples☆79May 20, 2017Updated 9 years ago
- Python script that periodically probes the Craigslist RSS feeds for new listings.☆39Aug 24, 2011Updated 14 years ago
- Scraping bhinneka.com, just for fun☆14Jan 28, 2013Updated 13 years ago
- Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc.☆3,258Nov 3, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Mongodb support for scrapy☆101Mar 9, 2017Updated 9 years ago
- MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the item…☆358Apr 6, 2021Updated 5 years ago
- scrapy examples for crawling zhihu and github☆222Jan 11, 2023Updated 3 years ago
- Scrapy (Python Framework) Example using reddit.com☆54Oct 16, 2018Updated 7 years ago
- Simple Craigslist wrapper☆393Aug 19, 2022Updated 3 years ago
- a blog starter project☆11Oct 29, 2018Updated 7 years ago
- Scrapy project to scrape public web directories (educational) [DEPRECATED]☆1,627Oct 27, 2017Updated 8 years ago
- Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect …☆136Aug 26, 2023Updated 2 years ago
- A helper to create web scrapers using scrapy selector in a Model based structure☆57Dec 26, 2022Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even whe…☆54May 21, 2024Updated 2 years ago
- A Python port of the Perl address parser available at http://search.cpan.org/~timb/Geo-StreetAddress-US-1.03/US.pm☆26Jan 31, 2019Updated 7 years ago
- light wrapper for indeed.com api☆16Oct 30, 2016Updated 9 years ago
- A Scrapy project for scraping restaurant information from zomato.com☆45Nov 21, 2015Updated 10 years ago
- A collection of examples and best practices for AngularJS projects☆15Apr 8, 2014Updated 12 years ago
- An online sentiment analyzer built with Flask and TextBlob☆15Sep 3, 2013Updated 12 years ago
- Coursera materials downloader.☆58Jan 20, 2023Updated 3 years ago
- 一个 python scrapy 爬虫 utility，定制任何我想抓取的web infomation！☆12Apr 7, 2014Updated 12 years ago
- Random proxy middleware for Scrapy☆1,668Oct 1, 2019Updated 6 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Easy to use Django admin interface.☆12Sep 22, 2016Updated 9 years ago
- Sample Crawler for Data Day Seattle☆10Jun 27, 2015Updated 10 years ago
- Fast way to integrate angular.js and require.js with Ruby on Rails project☆18Jun 23, 2015Updated 10 years ago
- A semantic analysis tool to generate synonym.txt files for Solr. [RETIRED]☆25Sep 14, 2016Updated 9 years ago
- Transcribe All The Things™ is a CLI for creating and managing speech-to-text transcripts.☆11Jul 18, 2019Updated 6 years ago
- Code to accompany presentation on Neo4j development practices☆21May 11, 2015Updated 11 years ago
- Scrapy extension to control spiders using JSON-RPC☆300Aug 26, 2019Updated 6 years ago
- Provide information for craigslist related metadata☆16Jan 9, 2017Updated 9 years ago
- CF item-based recommender system☆29Aug 4, 2011Updated 14 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Arbitrage Engine for Amazon, eBay, and Facebook Marketplace☆35Jul 8, 2018Updated 7 years ago
- ☆17Jan 30, 2016Updated 10 years ago
- Scrapy spiders of major websites. Google Play Store, Facebook, Instagram, Ebay, YTS Movies, Amazon☆298Jul 20, 2017Updated 8 years ago
- IPython Magic Functions☆16Aug 14, 2017Updated 8 years ago
- Materials for the PyData Carolinas 2016 tutorial, Turning Jupyter Notebooks into Data Applications☆18Sep 15, 2016Updated 9 years ago
- A C-based multi-threaded password cracker with GTK GUI working on several protocols (HTTP, FTP, SMTP, POP3, IMAP, SSH). Supports SSL/TLS …☆15Feb 17, 2018Updated 8 years ago
- Utility to re-structure research papers published in US Letter or A4 format PDF files to typically remove the 2 columns layout.☆53Nov 8, 2010Updated 15 years ago