simon987 / Architeuthis
MITM HTTP(S) proxy with integrated load-balancing, rate-limiting and error handling. Built for automated web scraping.
ā41Updated 5 years ago
Alternatives and similar repositories for Architeuthis:
Users that are interested in Architeuthis are comparing it to the libraries listed below
- š¾ Easily manage access to your open directory through OAuth2ā78Updated 2 years ago
- š¾ YouTube video metadata archiver written in Golangā19Updated 5 years ago
- A server to collect & archive websites that also supports video downloadsā86Updated 2 years ago
- Distributed crawler, database and web frontend for public directories indexingā142Updated 5 years ago
- A UDP torrent tracker scraper library written in Python 3ā54Updated 2 years ago
- Configurable Scraper & Downloader, Powered by RegExp and Goā64Updated 2 years ago
- go-ia is a command-line interface for interacting with archive.org written in Go.ā61Updated 3 years ago
- A dockerized, queued high fidelity web archiver based on Squidwarcā58Updated 10 months ago
- Easily archive important Reddit post threads onto your computerā61Updated 2 years ago
- Like curl, or wget, but downloads directly go to a SQLite databseā25Updated 4 years ago
- š Media Request Systemā19Updated 4 years ago
- wpull fork with fixes and faster parsing using html5-parser; used by grab-site; should go away when wpull is similarly improvedā28Updated 10 months ago
- š Easy and effective communication for any team or community.ā34Updated 3 years ago
- A totally configurable terminal torrent client.ā82Updated 4 years ago
- A Docker image that contains a set of tools for compressing and optimize images in many formats with high results, it also includes GNU Pā¦ā20Updated last year
- Go library to scrape torrents on any UDP trackerā20Updated 6 years ago
- Package pwnedpass is a Go package for querying a local instance of Troy Hunt's Pwned Passwords database.ā15Updated last year
- WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.ā46Updated 7 years ago
- Automation for the serious data hoarder that wants to have their data and use itā102Updated 3 years ago
- A self-hosted drag-and-drop, nosql yet fully-featured file-scanning server.ā30Updated 3 years ago
- Easy to use rclone mount/unmount scriptsā10Updated 5 years ago
- ā35Updated 5 years ago
- ā56Updated 3 years ago
- Matterbridge API plugin for Reddit Community Chatā16Updated 2 years ago
- Scrapes an arbitrary number of lines from a Discord channelā25Updated 6 years ago
- Downloader for submissions to reddit.com. Supports both subreddits and users.ā49Updated 5 years ago
- Get results from search engines.ā12Updated 2 years ago
- Vimtur Media Managerā83Updated 2 weeks ago
- Hekate, a highly-concurrent BitTorrent seederā75Updated 11 years ago
- š§ AI powered image tagger backed by DeepDetectā245Updated 6 years ago