mk-fg / image-deduplication-toolLinks
Tool to detect (and get rid of) similar images using perceptual hashing (pHash lib)
☆83Updated 8 years ago
Alternatives and similar repositories for image-deduplication-tool
Users that are interested in image-deduplication-tool are comparing it to the libraries listed below
Sorting:
- Tool for managing data-deduplication within extant compressed archive files, along with a relatively performant BK tree implementation fo…☆104Updated 2 years ago
- Implementation of perceptual image hash calculation in Python☆132Updated last year
- WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.☆47Updated 7 years ago
- Wget-compatible web downloader and crawler.☆592Updated last year
- Python library for reading and writing warc files☆245Updated 3 years ago
- Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.☆46Updated 7 years ago
- Grabbing all news.☆62Updated 5 years ago
- Serving content from a WARC☆62Updated 12 years ago
- Check out https://github.com/webrecorder/webrecorder for newer version matching https://webrecorder.io☆38Updated 9 years ago
- unified cli for various saas image classification apis.☆40Updated 8 years ago
- Recover lost websites from the Web Infrastructure☆89Updated 2 months ago
- A Python Perceptual Image Hashing Module☆214Updated 3 years ago
- Web archiving using Google Chrome☆47Updated 5 years ago
- An eBook tool to extract ISBN or Metadata form eBook and rename them by using ISBN database and Metadata☆30Updated 10 years ago
- jpeginfo - prints information and tests integrity of JPEG/JFIF files☆150Updated 8 months ago
- 🧠 AI powered image tagger backed by DeepDetect☆249Updated 7 years ago
- A list of tools related to W(eb)ARC(hive)☆64Updated 10 years ago
- DIY Atom feeds in times of social media and paywalls☆85Updated last year
- A dockerized, queued high fidelity web archiver based on Squidwarc☆61Updated last year
- A Tool To Push Web Resources Into Web Archives☆422Updated last year
- A script to find and delete duplicate images using pHash.☆521Updated last year
- [Deprecated] Get (almost) original messages from google group archives. Your data is yours.☆218Updated 3 years ago
- isk-daemon is an open source standalone server and library capable of adding content-based (visual) image searching to any image related …☆140Updated 10 years ago
- Save a bunch of web pages as a self-contained, compressed archive file for offline storage and sharing.☆35Updated 12 years ago
- ArchiveBot, an IRC bot for archiving websites☆400Updated 2 months ago
- Identifies similar pictures on your local computer☆78Updated 6 years ago
- Rename images using deep learning☆153Updated 2 years ago
- Web Archiving Integration Layer: One-Click User Instigated Preservation☆379Updated 6 months ago
- Easily archive important Reddit post threads onto your computer☆59Updated 3 years ago
- A list of things related to software, literature, and other content for 🕣 Memento☆99Updated last year