IanLondon / detectorist-scraper
A scrapy spider to extract post, thread, and user information from a vBulletin forum to a MongoDB database.
☆31Updated 9 years ago
Alternatives and similar repositories for detectorist-scraper:
Users that are interested in detectorist-scraper are comparing it to the libraries listed below
- Console program to get global ranking for a given website or domain☆21Updated 2 years ago
- A modular template for scraping data from the web to send yourself scheduled email reports☆40Updated 4 years ago
- A Scrapy crawler for http://books.toscrape.com☆27Updated 7 years ago
- Python scripts that download metadata and tweets for given users.☆18Updated 3 years ago
- data with similar subreddits graph☆45Updated last year
- Search torrents from multiple websites via the CLI☆32Updated last year
- sync a website or local spreadsheet with a google sheet☆35Updated 2 years ago
- Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords☆44Updated last year
- scraping from walmart, target and homedepot website and getting data from amazon api☆16Updated 8 years ago
- A script for gathering facesets from online videos☆36Updated 7 years ago
- Didactic Web crawler for Web Search Engines (CS 6913) course at NYU☆11Updated 2 years ago
- The Bibliotheca Anonoma's own Bing Cache and Google Cache scraper scripts. Unlike most of the other ones you've seen, these actually work…☆28Updated 7 years ago
- Decentralized web archiving☆20Updated 6 years ago
- Python module to watch Twitter user pages or search-results.☆62Updated 10 years ago
- YouTube Downloader Flask version.☆15Updated 6 years ago
- Retrieves the full list of available Google Voice numbers and finds the best ones☆31Updated 5 years ago
- Utilities & scripts to collect and find insight from social network data and users.☆25Updated 5 years ago
- Procedural Content Generator☆22Updated 3 years ago
- WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.☆46Updated 7 years ago
- Opensource scraper for analyse of social networks. Create nodes with egdes for you to visualize on editors like gephi.☆10Updated 5 months ago
- API - extract a list of keywords from a text.☆18Updated 7 years ago
- twitter news bot that builds followers, posts, and bitcoin via ppc links☆17Updated 4 years ago
- The repository for the MapPorn bot on Reddit☆25Updated last year
- Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect …☆131Updated last year
- A Python script to make a still image appear like a video recording☆25Updated 8 years ago
- Grabbing all news.☆62Updated 5 years ago
- Data analytics tool that tracks trending Etsy listings and analyzes tag frequencies to provide SEO insights. Helps shop owners optimize t…☆32Updated 2 months ago
- The tiniest file-sharing server. Roughly equivalent to 1e-15 ordinary file-sharing servers.☆9Updated 2 years ago
- Python library with common functionality for writing web scrapers☆102Updated 9 years ago
- This little python script downloads the content from solidfiles. The reason I came up with this is 'SolidFiles using too much Pop Ups'. J…☆13Updated 6 years ago