An almost generic web crawler built using Scrapy and Python 3.7 to recursively crawl entire websites.
☆17Mar 1, 2022Updated 4 years ago
Alternatives and similar repositories for Multisite-Python-Crawler
Users that are interested in Multisite-Python-Crawler are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code and data for the CCS'19 paper "Watching You Watch: The Tracking Ecosystem of Over-the-TopTV Streaming Devices"☆13Dec 14, 2019Updated 6 years ago
- Scripts for Internet Archive☆14Mar 26, 2025Updated last year
- Leakix Searcher☆15Apr 30, 2021Updated 5 years ago
- Circa 2011 snapshot of Encyclopedia Dramatica that survived the Oh Internet fiasco☆10Mar 6, 2016Updated 10 years ago
- Mods to make pimeyes.com work better for both premium and free users☆12Feb 21, 2026Updated 5 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Python Toolbox For Rosetta Silent Files Processing☆10Aug 2, 2021Updated 5 years ago
- Unoffical documentation of the Tinder API☆10Dec 3, 2021Updated 4 years ago
- Pipeline for Nanopore sequencing: demultiplexing, variant calling, and quality visualization with error handling.☆12May 10, 2026Updated 3 months ago
- ☆11Aug 5, 2020Updated 6 years ago
- GitHub for AI4PD 2023 Workshop in Chile☆12Oct 12, 2023Updated 2 years ago
- Graphinity: Equivariant Graph Neural Network Architecture for Predicting Change in Antibody-Antigen Binding Affinity☆13Jul 9, 2025Updated last year
- Inpainting protein sequence and structure☆12Nov 10, 2023Updated 2 years ago
- Recursively extract urls from a web page for reconnaissance.☆12Jun 9, 2024Updated 2 years ago
- Code and software used to design de novo protein nanomachines. Supplementary material for "Computational design of nanoscale rotational m…☆10Mar 19, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12Jun 16, 2023Updated 3 years ago
- A series of scripts that facilitate the prediction of user-defined protein structural properties using AlphaFold2☆12Aug 28, 2023Updated 2 years ago
- an API for Literotica☆10Apr 13, 2012Updated 14 years ago
- ☆10Nov 10, 2023Updated 2 years ago
- A Google images scraper to collect a labeled face dataset.☆11Oct 24, 2018Updated 7 years ago
- A library and command line tool utility to organise your media ( Photos and videos ) better☆16Nov 15, 2018Updated 7 years ago
- Image downloader for various imageboards and image albums written in Python.☆10Sep 21, 2019Updated 6 years ago
- Download complete deviantart galleries. Change your desktop wallpaper. Python script and Windows/Linux wallpaper changer included.☆13Dec 27, 2025Updated 7 months ago
- Download your facebook's albums on your computer with python and Facebook API☆15Nov 16, 2012Updated 13 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆13Apr 1, 2026Updated 4 months ago
- ☆12May 16, 2020Updated 6 years ago
- Your open-source alternative to AlphaFold3🚀☆10Jun 20, 2024Updated 2 years ago
- Collected scripts for Pymol☆10Mar 18, 2015Updated 11 years ago
- ☆11Jan 2, 2021Updated 5 years ago
- ☆12Nov 16, 2023Updated 2 years ago
- Similar image scrapper from google reverse image search using selenium☆17Mar 21, 2018Updated 8 years ago
- Automatic, fast parsing of browser artifacts☆17Jan 4, 2025Updated last year
- Train a production grade GPT in less than 400 lines of code. Better than Karpathy's verison and GIGAGPT☆17Aug 3, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Bybit API client library for Go (ByBit API connector)☆10Updated this week
- OPUS-Rota4: A Gradient-Based Protein Side-Chain Modeling Framework Assisted by Deep Learning-Based Predictors☆10Apr 14, 2022Updated 4 years ago
- Thesis: Measure The Speed Of News Spread in Social Networks For Real-Time Fake News Detection☆10Jun 7, 2021Updated 5 years ago
- A website classification which detect the type of a website (sex or no sex, magazine site or story site, music site,..)☆16Mar 1, 2022Updated 4 years ago
- uyghur text resource crawled from website☆12Dec 25, 2015Updated 10 years ago
- Modelling RBP binding preferences to predict RPB binding sites☆11Mar 4, 2021Updated 5 years ago
- Extract ligand binding sites from PDB. Match the binding sites to de novo scaffolds.☆12Dec 29, 2020Updated 5 years ago