Alternatives and similar repositories for image-deduplication-tool

Users that are interested in image-deduplication-tool are comparing it to the libraries listed below

• knjcode / imgdupes
  Identifying and removing near-duplicate images using perceptual hashing.
  ☆385Updated 8 months ago
• odie5533 / WarcMiddleware
  WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.
  ☆47Updated 7 years ago
• fake-name / IntraArchiveDeduplicator
  Tool for managing data-deduplication within extant compressed archive files, along with a relatively performant BK tree implementation fo…
  ☆106Updated 2 years ago
• alard / warc-proxy
  Serving content from a WARC
  ☆62Updated 12 years ago
• ArchiveTeam / NewsGrabber
  Grabbing all news.
  ☆62Updated 6 years ago
• PyFeeds / PyFeeds
  DIY Atom feeds in times of social media and paywalls
  ☆85Updated last year
• fake-name / ReadableWebProxy
  Rewriting web proxy and archival tool. At this point, it just tries to download all the things.
  ☆203Updated this week
• N0taN3rd / Squidwarc
  Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head
  ☆172Updated 5 years ago
• CorentinB / DeepSort
  🧠 AI powered image tagger backed by DeepDetect
  ☆251Updated 7 years ago
• idibidiart / AllSeeingEye
  Google Chrome Extension. Record All Browsing in Screenshots & Full Text. Search For Anything At Any Time. Never Forget Where You Read Som…
  ☆309Updated 8 years ago
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆47Updated 8 years ago
• markusressel / py-image-dedup
  CLI utility to find near duplicate images and remove all but the best copy.
  ☆169Updated last week
• N0taN3rd / wail
  One-Click User Instigated Preservation
  ☆129Updated 6 years ago
• internetarchive / umbra
  A queue-controlled browser automation tool for improving web crawl quality
  ☆64Updated 4 months ago
• palewire / archiveis
  A simple Python wrapper for the archive.is capturing service
  ☆209Updated 10 months ago
• ikreymer / pywb-webrecorder
  Check out https://github.com/webrecorder/webrecorder for newer version matching https://webrecorder.io
  ☆38Updated 10 years ago
• gaul / object-store-comparison
  Compare cost, durability, and region support of public cloud object stores, e.g., Amazon S3
  ☆71Updated 7 years ago
• FelipeCortez / bmarks
  Tag-based bookmark manager inspired by delicious and Pinboard
  ☆34Updated 3 years ago
• commonsmachinery / blockhash-python
  Implementation of perceptual image hash calculation in Python
  ☆133Updated 2 years ago
• mitio / useful-ffmpeg-commands
  A collection of FFmpeg commands taken from practice
  ☆176Updated 8 years ago
• internetarchive / warc
  Python library for reading and writing warc files
  ☆246Updated 3 years ago
• 28mm / Fovea
  unified cli for various saas image classification apis.
  ☆40Updated 8 years ago
• scanner-research / esper-tv
  Esper instance for TV news analysis
  ☆40Updated 3 years ago
• EugenePig / ebook-isbn
  An eBook tool to extract ISBN or Metadata form eBook and rename them by using ISBN database and Metadata
  ☆29Updated 10 years ago
• przemoc / metastore
  Store and restore metadata from a filesystem.
  ☆179Updated 2 years ago
• icy / google-group-crawler
  [Deprecated] Get (almost) original messages from google group archives. Your data is yours.
  ☆218Updated 3 years ago
• philipbl / duplicate-images
  A script to find and delete duplicate images using pHash.
  ☆523Updated 2 years ago
• agarden / remove-pdf-watermark
  Short script for removing watermarks from PDF files. Requires pdftk.
  ☆59Updated 6 years ago
• psolbach / mehrwert
  Aviation grade news article metadata extraction
  ☆36Updated 2 years ago
• anvaka / ghindex
  Creates github index for similar repositories discovery
  ☆192Updated 9 years ago