mk-fg / image-deduplication-toolLinks
Tool to detect (and get rid of) similar images using perceptual hashing (pHash lib)
☆84Updated 9 years ago
Alternatives and similar repositories for image-deduplication-tool
Users that are interested in image-deduplication-tool are comparing it to the libraries listed below
Sorting:
- Tool for managing data-deduplication within extant compressed archive files, along with a relatively performant BK tree implementation fo…☆106Updated 2 years ago
- WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.☆48Updated 7 years ago
- Rewriting web proxy and archival tool. At this point, it just tries to download all the things.☆203Updated last week
- Tool for downloading sets and photos from Flickr☆252Updated 2 weeks ago
- Wget-compatible web downloader and crawler.☆599Updated last year
- Grabbing all news.☆61Updated 6 years ago
- Rename images using deep learning☆155Updated 3 years ago
- 🧠 AI powered image tagger backed by DeepDetect☆251Updated 7 years ago
- A Python Perceptual Image Hashing Module☆217Updated 3 years ago
- Esper instance for TV news analysis☆40Updated 3 years ago
- Serving content from a WARC☆62Updated 13 years ago
- A simple Python wrapper for the archive.is capturing service☆215Updated last year
- unified cli for various saas image classification apis.☆40Updated 8 years ago
- An eBook tool to extract ISBN or Metadata form eBook and rename them by using ISBN database and Metadata☆29Updated 10 years ago
- Python library for reading and writing warc files☆247Updated 3 years ago
- Check out https://github.com/webrecorder/webrecorder for newer version matching https://webrecorder.io☆38Updated 10 years ago
- Identifies similar pictures on your local computer☆78Updated 6 years ago
- DIY Atom feeds in times of social media and paywalls☆85Updated last week
- Python (+ rsync or rclone) based intelligent file sync with automatic backups and file move/delete tracking.☆113Updated 4 years ago
- Intelligent Bookmarking☆265Updated 3 years ago
- A command line utility for organizing files and directories according to regex patterns.☆44Updated 3 years ago
- Google Chrome Extension. Record All Browsing in Screenshots & Full Text. Search For Anything At Any Time. Never Forget Where You Read Som…☆309Updated 8 years ago
- Searching for the occurrence seconds of words/phrases or arbitrary regex patterns within audio files☆102Updated 5 years ago
- Document Management System (scanner -> appengine blobs)☆148Updated 10 years ago
- Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head☆173Updated 5 years ago
- Tag-based bookmark manager inspired by delicious and Pinboard☆34Updated 3 years ago
- A list of tools related to W(eb)ARC(hive)☆67Updated 11 years ago
- Creates github index for similar repositories discovery☆191Updated 9 years ago
- Recover files using lists of blocks hashes, bypassing the File System entirely☆50Updated 7 years ago
- Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.☆47Updated 8 years ago