An almost generic web crawler built using Scrapy and Python 3.7 to recursively crawl entire websites.
☆17Mar 1, 2022Updated 4 years ago
Alternatives and similar repositories for Multisite-Python-Crawler
Users that are interested in Multisite-Python-Crawler are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Shareaholic Public API & SDK documentation☆11Dec 17, 2022Updated 3 years ago
- Code and data for the CCS'19 paper "Watching You Watch: The Tracking Ecosystem of Over-the-TopTV Streaming Devices"☆13Dec 14, 2019Updated 6 years ago
- Scripts for Internet Archive☆14Mar 26, 2025Updated last year
- Leakix Searcher☆16Apr 30, 2021Updated 5 years ago
- Circa 2011 snapshot of Encyclopedia Dramatica that survived the Oh Internet fiasco☆11Mar 6, 2016Updated 10 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13May 24, 2026Updated 3 months ago
- Mods to make pimeyes.com work better for both premium and free users☆12Feb 21, 2026Updated 6 months ago
- Decentralized web archiving☆20Aug 7, 2018Updated 8 years ago
- Python Toolbox For Rosetta Silent Files Processing☆10Aug 2, 2021Updated 5 years ago
- ☆13Mar 6, 2020Updated 6 years ago
- Scraper for TED Talks in Python. Get talk title, transcript, talk topics and so on.☆15Sep 14, 2017Updated 8 years ago
- Pipeline for Nanopore sequencing: demultiplexing, variant calling, and quality visualization with error handling.☆12May 10, 2026Updated 3 months ago
- Generate a Tinder API access token given Facebook credentials☆11Jan 3, 2023Updated 3 years ago
- Provide a friendly and robust API for Google, Bing, Baidu, So, DuckDuckGo etc.☆18Dec 25, 2017Updated 8 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆11Aug 5, 2020Updated 6 years ago
- Graphinity: Equivariant Graph Neural Network Architecture for Predicting Change in Antibody-Antigen Binding Affinity☆14Jul 9, 2025Updated last year
- A demo and tutorial for Council that implements a research writing assistant.☆11Nov 10, 2023Updated 2 years ago
- Inpainting protein sequence and structure☆13Nov 10, 2023Updated 2 years ago
- Recursively extract urls from a web page for reconnaissance.☆12Jun 9, 2024Updated 2 years ago
- Code and software used to design de novo protein nanomachines. Supplementary material for "Computational design of nanoscale rotational m…☆10Mar 19, 2022Updated 4 years ago
- A stacked LSTM based Network for Text Summarization Using Keras☆11Aug 2, 2020Updated 6 years ago
- ☆12Jun 16, 2023Updated 3 years ago
- A series of scripts that facilitate the prediction of user-defined protein structural properties using AlphaFold2☆12Aug 28, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- an API for Literotica☆10Apr 13, 2012Updated 14 years ago
- reviese pyrouge files for supporting winxp win 8.1 win10☆12Nov 21, 2017Updated 8 years ago
- ☆10Nov 10, 2023Updated 2 years ago
- Fast & Accurate Username Scanner (Frontend)☆10Nov 28, 2021Updated 4 years ago
- A Google images scraper to collect a labeled face dataset.☆11Oct 24, 2018Updated 7 years ago
- A library and command line tool utility to organise your media ( Photos and videos ) better☆16Nov 15, 2018Updated 7 years ago
- Python package to parse news from various news website☆13Sep 19, 2018Updated 7 years ago
- Image downloader for various imageboards and image albums written in Python.☆10Sep 21, 2019Updated 6 years ago
- Download complete deviantart galleries. Change your desktop wallpaper. Python script and Windows/Linux wallpaper changer included.☆13Dec 27, 2025Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 基于文字密度的新闻正文提取模块，兼容python2和python3，传入新闻网址或者网页源码即可返回标题，发布时间和正文内容。☆14Jun 10, 2018Updated 8 years ago
- Tools that run inside the guest☆11Jan 2, 2020Updated 6 years ago
- ☆13Updated this week
- Discover which of your Facebook friends are on Tinder!☆16Oct 10, 2022Updated 3 years ago
- ☆12May 16, 2020Updated 6 years ago
- Quake Command-Line Application With Golang☆11Jul 20, 2023Updated 3 years ago
- Your open-source alternative to AlphaFold3🚀☆10Jun 20, 2024Updated 2 years ago