mk-fg / image-deduplication-toolLinks
Tool to detect (and get rid of) similar images using perceptual hashing (pHash lib)
☆83Updated 8 years ago
Alternatives and similar repositories for image-deduplication-tool
Users that are interested in image-deduplication-tool are comparing it to the libraries listed below
Sorting:
- WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.☆47Updated 7 years ago
- Tool for managing data-deduplication within extant compressed archive files, along with a relatively performant BK tree implementation fo…☆104Updated 2 years ago
- Grabbing all news.☆62Updated 5 years ago
- Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.☆46Updated 7 years ago
- Tool for downloading sets and photos from Flickr☆246Updated last month
- CLI utility to find near duplicate images and remove all but the best copy.☆166Updated this week
- a Python library to communicate with an instance of Phil Harvey's excellent ExifTool command-line application.☆276Updated last year
- 🧠 AI powered image tagger backed by DeepDetect☆249Updated 7 years ago
- isk-daemon is an open source standalone server and library capable of adding content-based (visual) image searching to any image related …☆140Updated 10 years ago
- Identifying and removing near-duplicate images using perceptual hashing.☆380Updated 6 months ago
- A Python Perceptual Image Hashing Module☆215Updated 3 years ago
- WARC writing MITM HTTP/S proxy☆426Updated 3 weeks ago
- Identifies similar pictures on your local computer☆78Updated 6 years ago
- Easily archive important Reddit post threads onto your computer☆63Updated 3 years ago
- A simple Python wrapper for the archive.is capturing service☆204Updated 8 months ago
- This is a python application for converting Youtube playlists and channels into podcast rss feeds.☆35Updated 2 years ago
- Python library for reading and writing warc files☆244Updated 3 years ago
- ImageCat is an Apache OODT RADIX application that uses Apache Solr, Apache Tika and Apache OODT to ingest 10s of millions of files (image…☆96Updated 7 years ago
- Esper instance for TV news analysis☆40Updated 2 years ago
- Recover lost websites from the Web Infrastructure☆89Updated 2 months ago
- Scrapy middleware which allows to crawl only new content☆79Updated 3 years ago
- Easily archive important Reddit post threads onto your computer☆59Updated 3 years ago
- Wget-compatible web downloader and crawler.☆594Updated last year
- Save a bunch of web pages as a self-contained, compressed archive file for offline storage and sharing.☆35Updated 12 years ago
- An eBook tool to extract ISBN or Metadata form eBook and rename them by using ISBN database and Metadata☆30Updated 10 years ago
- Implementation of perceptual image hash calculation in Python☆132Updated 2 years ago
- A command line utility for organizing files and directories according to regex patterns.☆44Updated 2 years ago
- Tag-based bookmark manager inspired by delicious and Pinboard☆34Updated 3 years ago
- A Python utility for moving bookmarks/reading lists between services☆206Updated 9 years ago
- Specialised bot for periodical grabs and video/audio/etc. webpage scrapes.☆11Updated 7 years ago