simon987 / ArchiteuthisLinks
MITM HTTP(S) proxy with integrated load-balancing, rate-limiting and error handling. Built for automated web scraping.
☆41Updated 5 years ago
Alternatives and similar repositories for Architeuthis
Users that are interested in Architeuthis are comparing it to the libraries listed below
Sorting:
- Distributed crawler, database and web frontend for public directories indexing☆142Updated 5 years ago
- A server to collect & archive websites that also supports video downloads☆84Updated 2 years ago
- 💾 Easily manage access to your open directory through OAuth2☆79Updated 2 years ago
- Reverse image/video search for reddit☆11Updated 5 years ago
- Convert HTTP Archive (HAR) -> Web Archive (WARC) format☆54Updated 7 years ago
- ☆56Updated 4 years ago
- 📒 Easy and effective communication for any team or community.☆33Updated 3 years ago
- 🧠 AI powered image tagger backed by DeepDetect☆250Updated 7 years ago
- Open directory indexer☆10Updated 2 years ago
- The subreddit archiver☆176Updated 2 years ago
- A list of tools related to W(eb)ARC(hive)☆65Updated 11 years ago
- Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)☆167Updated 3 months ago
- Grabbing all news.☆62Updated 5 years ago
- A UDP torrent tracker scraper library written in Python 3☆52Updated 2 years ago
- Easily archive important Reddit post threads onto your computer☆63Updated 3 years ago
- Subtitle Download Service☆16Updated 3 years ago
- ArchiveBot, an IRC bot for archiving websites☆402Updated 4 months ago
- A collection of tools that interact with reddit's API providing moderator utilities, subreddit statistics, and keyword alerts.☆117Updated 2 years ago
- The Seesaw pipeline grab script for the URLTeam (terroroftinytown) project☆28Updated 4 months ago
- WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.☆47Updated 7 years ago
- Easy to use rclone mount/unmount scripts☆10Updated 6 years ago
- Hekate, a highly-concurrent BitTorrent seeder☆76Updated 12 years ago
- Web archiving using Google Chrome☆46Updated 5 years ago
- A totally configurable terminal torrent client.☆81Updated 4 years ago
- A dockerized, queued high fidelity web archiver based on Squidwarc☆61Updated last year
- A terminal client to access srrdb.com☆21Updated this week
- Configurable Scraper & Downloader, Powered by RegExp and Go☆64Updated 2 years ago
- Configure, launch, and work in Dockerized environments☆32Updated 5 years ago
- 📃 Media Request System☆19Updated 5 years ago
- Teamdrive Manager! Automate Teamdrive Generation and Permissions. Download normal Files☆25Updated 6 years ago