mk-fg / image-deduplication-toolLinks
Tool to detect (and get rid of) similar images using perceptual hashing (pHash lib)
☆84Updated 9 years ago
Alternatives and similar repositories for image-deduplication-tool
Users that are interested in image-deduplication-tool are comparing it to the libraries listed below
Sorting:
- WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.☆48Updated 7 years ago
- Serving content from a WARC☆62Updated 13 years ago
- Tool for managing data-deduplication within extant compressed archive files, along with a relatively performant BK tree implementation fo…☆106Updated 2 years ago
- Esper instance for TV news analysis☆40Updated 3 years ago
- A queue-controlled browser automation tool for improving web crawl quality☆64Updated 5 months ago
- A simple Python wrapper for the archive.is capturing service☆212Updated 11 months ago
- Rename images using deep learning☆155Updated 3 years ago
- Save a bunch of web pages as a self-contained, compressed archive file for offline storage and sharing.☆35Updated 13 years ago
- 🧠 AI powered image tagger backed by DeepDetect☆251Updated 7 years ago
- Implementation of perceptual image hash calculation in Python☆133Updated 2 years ago
- Tool for downloading sets and photos from Flickr☆251Updated 2 weeks ago
- Grabbing all news.☆61Updated 6 years ago
- Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.☆47Updated 8 years ago
- Wget-compatible web downloader and crawler.☆599Updated last year
- WARC writing MITM HTTP/S proxy☆438Updated last week
- A Python Perceptual Image Hashing Module☆216Updated 3 years ago
- Python script to keep track of website updates; sends email notifications and provides RSS2 feed☆78Updated last year
- Google Chrome Extension. Record All Browsing in Screenshots & Full Text. Search For Anything At Any Time. Never Forget Where You Read Som…☆309Updated 8 years ago
- An eBook tool to extract ISBN or Metadata form eBook and rename them by using ISBN database and Metadata☆29Updated 10 years ago
- Python library for reading and writing warc files☆247Updated 3 years ago
- Short script for removing watermarks from PDF files. Requires pdftk.☆59Updated 6 years ago
- A command line utility for organizing files and directories according to regex patterns.☆44Updated 3 years ago
- 📂🛡️Suite of tools for file fixity (data protection for long term storage⌛) using redundant error correcting codes, hash auditing and du…☆153Updated 4 months ago
- a command-line web scraping tool☆151Updated 2 years ago
- Turn video files into 'barcodes' where vertical lines represent the average colour of individual frames.☆86Updated 10 years ago
- A simple headless browser☆76Updated 2 years ago
- Searching for the occurrence seconds of words/phrases or arbitrary regex patterns within audio files☆102Updated 5 years ago
- Suite of tools for detecting changes in web pages and their rendering☆55Updated 2 years ago
- A python script to backup the contents of private Yahoo! groups.☆37Updated 6 years ago
- CLI utility to find near duplicate images and remove all but the best copy.☆170Updated last week