simon987 / ArchiteuthisLinks
MITM HTTP(S) proxy with integrated load-balancing, rate-limiting and error handling. Built for automated web scraping.
☆41Updated 5 years ago
Alternatives and similar repositories for Architeuthis
Users that are interested in Architeuthis are comparing it to the libraries listed below
Sorting:
- 💾 Easily manage access to your open directory through OAuth2☆78Updated 2 years ago
- Convert HTTP Archive (HAR) -> Web Archive (WARC) format☆54Updated 6 years ago
- A UDP torrent tracker scraper library written in Python 3☆53Updated 2 years ago
- 🧠 AI powered image tagger backed by DeepDetect☆249Updated 7 years ago
- A server to collect & archive websites that also supports video downloads☆86Updated 2 years ago
- A self-hosted drag-and-drop, nosql yet fully-featured file-scanning server.☆30Updated 3 years ago
- A list of tools related to W(eb)ARC(hive)☆64Updated 10 years ago
- Distributed crawler, database and web frontend for public directories indexing☆141Updated 5 years ago
- Web archiving using Google Chrome☆47Updated 5 years ago
- NZB Filesystem using FUSE/Python☆19Updated 9 years ago
- Reverse image/video search for reddit☆11Updated 5 years ago
- Hekate, a highly-concurrent BitTorrent seeder☆76Updated 12 years ago
- A dockerized, queued high fidelity web archiver based on Squidwarc☆61Updated last year
- 📒 Easy and effective communication for any team or community.☆33Updated 3 years ago
- Like Tor2Web, but not just HTTP ( using IPv6 )☆127Updated 4 years ago
- WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.☆47Updated 7 years ago
- Simple file sharing from the browser and the command-line.☆126Updated last year
- collected yatb sources + small fixes☆14Updated 3 years ago
- Search in multiple torrent sites from your CLI☆69Updated 2 years ago
- ☆56Updated 4 years ago
- We back up a lot of stuff from around the web; now it's time to back up the Internet Archive, just in case.☆92Updated 5 years ago
- The Seesaw pipeline grab script for the URLTeam (terroroftinytown) project☆28Updated 2 months ago
- Easy to use rclone mount/unmount scripts☆10Updated 6 years ago
- A terminal client to access srrdb.com☆21Updated 3 years ago
- Reddit image scraper made in Python☆47Updated 2 years ago
- ArchiveBot, an IRC bot for archiving websites☆400Updated 2 months ago
- 💾 YouTube video metadata archiver written in Golang☆20Updated 5 years ago
- The subreddit archiver☆177Updated 2 years ago
- Configurable Scraper & Downloader, Powered by RegExp and Go☆64Updated 2 years ago
- Script to import youtube-dl metadata to PostgreSQL☆14Updated 7 years ago