fake-name / IntraArchiveDeduplicatorLinks
Tool for managing data-deduplication within extant compressed archive files, along with a relatively performant BK tree implementation for fuzzy image searching.
☆102Updated last year
Alternatives and similar repositories for IntraArchiveDeduplicator
Users that are interested in IntraArchiveDeduplicator are comparing it to the libraries listed below
Sorting:
- ☆89Updated last year
- Github-Repository of the pHash.org library for perceptual hashing.☆223Updated 7 years ago
- bktree data structure with a Python interface for a CPP implementation☆13Updated 8 years ago
- Implementation of perceptual image hash calculation in Python☆131Updated last year
- Detect source resolution of upscaled images☆253Updated this week
- A reverse image search algorithm which performs 2D affine transformation-invariant partial image-matching in sublinear time☆290Updated 5 years ago
- Serving content from a WARC☆61Updated 12 years ago
- Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.☆46Updated 7 years ago
- Python BK-tree data structure to allow fast querying of "close" matches☆184Updated 3 years ago
- WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.☆46Updated 7 years ago
- Tool to detect (and get rid of) similar images using perceptual hashing (pHash lib)☆82Updated 8 years ago
- ☆26Updated 9 years ago
- A Python binding for libpuzzle.☆45Updated 4 years ago
- A decentralized browser☆413Updated 11 years ago
- C++ implementation of hamming distance algorithm HmSearch using Kyoto Cabinet☆42Updated 9 years ago
- 📂🛡️Suite of tools for file fixity (data protection for long term storage⌛) using redundant error correcting codes, hash auditing and du…☆144Updated 9 months ago
- Saves proxied HTTP traffic to a WARC file.☆28Updated 11 years ago
- search, dedupe, and media ingestion for mediachain☆33Updated 8 years ago
- Insight Perceptual Hashing Engine☆61Updated 10 years ago
- Fast text chunking algorithms for Python☆12Updated 4 years ago
- Encrypted backups (without the backups)☆120Updated 10 years ago
- ☆67Updated 7 years ago
- JPEG Optimization☆56Updated 10 years ago
- Making a reusable toolkit for writing seesaw scripts☆70Updated 2 years ago
- Locality-sensitive hashing algorithm for text similarity comparisons☆58Updated 2 months ago
- Hardlink/Deduplication Backups with Python☆16Updated 2 years ago
- A library for sending software performance metrics from Python libraries and apps to statsd.☆30Updated last year
- A slim, non-SWIG Python adapter to CTesseract (Tesseract OCR for C).☆24Updated 11 years ago
- Python library for reading and writing warc files☆241Updated 3 years ago
- Fuse tag file system☆126Updated 6 years ago