Alternatives and similar repositories for IntraArchiveDeduplicator:

Users that are interested in IntraArchiveDeduplicator are comparing it to the libraries listed below

• commonsmachinery / blockhash-python
  Implementation of perceptual image hash calculation in Python
  ☆131Updated last year
• alard / warc-proxy
  Serving content from a WARC
  ☆61Updated 12 years ago
• 0x09 / resdet
  Detect source resolution of upscaled images
  ☆242Updated last year
• commonsmachinery / blockhash
  ☆89Updated last year
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆46Updated 7 years ago
• odie5533 / WarcMiddleware
  WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.
  ☆46Updated 7 years ago
• internetarchive / umbra
  A queue-controlled browser automation tool for improving web crawl quality
  ☆61Updated last month
• commonsmachinery / hmsearch
  C++ implementation of hamming distance algorithm HmSearch using Kyoto Cabinet
  ☆42Updated 8 years ago
• mk-fg / image-deduplication-tool
  Tool to detect (and get rid of) similar images using perceptual hashing (pHash lib)
  ☆82Updated 8 years ago
• keenerd / gz-sort
  A utility for sorting really big files. http://kmkeen.com/gz-sort/
  ☆93Updated 6 years ago
• fake-name / AutoTriever
  Remote client for distributed automated HTTP(s) content fetching.
  ☆77Updated this week
• fake-name / ReadableWebProxy
  Rewriting web proxy and archival tool. At this point, it just tries to download all the things.
  ☆202Updated last week
• internetarchive / warc
  Python library for reading and writing warc files
  ☆239Updated 3 years ago
• pippy360 / transformationInvariantImageSearch
  A reverse image search algorithm which performs 2D affine transformation-invariant partial image-matching in sublinear time
  ☆290Updated 5 years ago
• alard / warctozip-service
  An HTTP-based warc-to-zip converter
  ☆11Updated 12 years ago
• rcarmo / rss2imap
  An adaptation of rss2mail that uses IMAP directly
  ☆86Updated 3 years ago
• devsnd / tarindexer
  python module for indexing tar files for fast access
  ☆76Updated 9 years ago
• wordnik / serapis
  Serapis is a sentence identifier and modeling pipeline / built for Wordnik
  ☆24Updated 8 years ago
• ArchiveTeam / seesaw-kit
  Making a reusable toolkit for writing seesaw scripts
  ☆70Updated last year
• ajslater / picopt
  A multi format lossless image optimizer that uses external tools
  ☆112Updated last week
• coleifer / sqlite-vtfunc
  Implement SQLite table-valued functions with Python
  ☆59Updated last year
• odie5533 / WarcProxy
  Saves proxied HTTP traffic to a WARC file.
  ☆27Updated 11 years ago
• jart / redisbayes
  Naïve Bayesian Text Classifier on Redis
  ☆116Updated 5 years ago
• ArchangelSDY / PyPuzzle
  A Python binding for libpuzzle.
  ☆45Updated 4 years ago
• mediachain / mediachain-indexer
  search, dedupe, and media ingestion for mediachain
  ☆33Updated 8 years ago
• netleibi / fastchunking
  Fast text chunking algorithms for Python
  ☆12Updated 4 years ago
• pytries / hat-trie
  HAT-Trie for Python
  ☆86Updated 9 years ago
• aalireza / SimpleAudioIndexer
  Searching for the occurrence seconds of words/phrases or arbitrary regex patterns within audio files
  ☆102Updated 4 years ago
• tex / fusecompress
  This project is not developed anymore. Transparent (using fuse) compressing filesystem.
  ☆97Updated 3 years ago
• psolbach / metadoc
  Aviation grade news article metadata extraction
  ☆37Updated 2 years ago