Find duplicate text files.
☆14Jan 14, 2025Updated last year
Alternatives and similar repositories for dedup
Users that are interested in dedup are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for extracting parallel corpora from pmindia☆17Jan 28, 2020Updated 6 years ago
- String deduplication package for Go☆19Jan 10, 2024Updated 2 years ago
- MemCachier Django usage example☆11Nov 29, 2018Updated 7 years ago
- The Lingotek Filesystem Connector (ltk) links your files and folders to the Translation Network™☆13May 7, 2026Updated 2 months ago
- Flickr Follower Bot : Bot for Flickr, in .Net Core, using a Chrome client and Selenium for command it☆12Mar 7, 2021Updated 5 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A Windows program to view/examine XLIFF file contents.☆14Sep 26, 2024Updated last year
- Various Java i18n tools, including tools for processing the Gettext and Properties formats☆15May 11, 2021Updated 5 years ago
- DEFUNCT: Realtime analysis of your Heroku app logs.☆140Oct 15, 2024Updated last year
- Book chapter for beautiful data☆15Jan 17, 2009Updated 17 years ago
- Assemble multiple Regular Expressions into a single RE☆15Nov 24, 2023Updated 2 years ago
- A fully featured soft-phone built with Plivo's webRTC Browser SDK☆17Sep 6, 2018Updated 7 years ago
- A text and media analysis service for Meedan Check, a collaborative media annotation platform☆15Jun 1, 2026Updated last month
- PyTorch - Albert Large V2, Bert Base Uncased, Bert Large Uncased WWM Finetuned Squad, Distil Roberta Base, Roberta Base Squad2, Roberta l…☆11Jul 10, 2020Updated 6 years ago
- ☆10Nov 22, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Wosp: advanced full-text search on the command line☆16Dec 27, 2025Updated 6 months ago
- Documentation for MX Linux☆12Jan 17, 2026Updated 6 months ago
- ☆12Mar 31, 2020Updated 6 years ago
- Free programming language books☆10Jun 4, 2020Updated 6 years ago
- convert subtitles to raw text☆10Nov 23, 2016Updated 9 years ago
- Dataset for Paper "Exploring Content Selection in Summarization of Novel Chapters"☆13Mar 20, 2023Updated 3 years ago
- A minimal Bash framework and CLI tool that makes writing, sharing and using bash scripts easy☆12Apr 23, 2026Updated 3 months ago
- Quick selection widget for Markdown notes, inspired by terminal_velocity☆13Jul 2, 2020Updated 6 years ago
- Provides syntax highlighting for Apptainer/Singularity definition files.☆10Dec 24, 2025Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Asynchronous Bittorrent Client written in C☆16Feb 13, 2024Updated 2 years ago
- Repository for our paper “Subverting the Jewtocracy”: Online Antisemitism Detection Using MultimodalDeep Learning☆12Apr 29, 2022Updated 4 years ago
- Simple and useful time tracker. Collects tasks and works (timeslots) in hierarchical tree. Has: reports (based on xslt templates), locali…☆16Nov 6, 2021Updated 4 years ago
- A JavaScript library for adding captioning to online videos. Also makes text transcript clickable, directing viewer to the point of the m…☆25Nov 24, 2011Updated 14 years ago
- Transformer based Trigram Blocking implementation in Tensorflow☆11Feb 26, 2020Updated 6 years ago
- Bash script to create an ebook from a list of web articles. Inspired by the now-defunct Readlists.org by Readability☆18Oct 13, 2019Updated 6 years ago
- ☆20Apr 24, 2023Updated 3 years ago
- This repository contains the implementation of the paper: "Span Classification with Structured Information for Disfluency Detection in Sp…☆14Jun 6, 2023Updated 3 years ago
- ☆24Mar 26, 2013Updated 13 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Scripts for building a geo-located web corpus using Common Crawl data☆11Jan 18, 2026Updated 6 months ago
- ☆14Feb 24, 2021Updated 5 years ago
- ☆12Jan 19, 2026Updated 6 months ago
- Automated Continuous Data Quality Measurement☆12Nov 15, 2023Updated 2 years ago
- ☆14Jun 29, 2024Updated 2 years ago
- A tool to find all duplicates in large sets of text documents.☆16Sep 29, 2021Updated 4 years ago
- ☆13Jul 6, 2026Updated 2 weeks ago