Python package for deduplication/entity resolution using active learning
☆82Aug 24, 2024Updated last year
Alternatives and similar repositories for deduplipy
Users that are interested in deduplipy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Record matching and entity resolution at scale in Spark☆36Oct 31, 2023Updated 2 years ago
- Spark Monitoring☆14Feb 28, 2023Updated 3 years ago
- MinHash implementation in Python☆12Aug 24, 2024Updated last year
- parquet dedupe estimator☆27May 26, 2026Updated 2 months ago
- Makes it easy to use altair from FastHTML☆28Oct 9, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Super Simple Similarities Service☆154Apr 11, 2025Updated last year
- Doubt your data, find bad labels.☆515Jul 15, 2024Updated 2 years ago
- Remove duplicate documents/videos/images via popular algorithms such as SimHash, SpotSig, Shingling, etc.☆19Aug 28, 2023Updated 2 years ago
- Small python package to measure OCR quality and other related metrics.☆26Feb 19, 2024Updated 2 years ago
- Entity resolution using zero labeled examples☆34Jun 29, 2024Updated 2 years ago
- Find duplicate text files.☆14Jan 14, 2025Updated last year
- Just charts. Really.☆23Sep 3, 2023Updated 2 years ago
- A merged read deduplication tool capable to perform merged read deduplication on single end data.☆14Sep 4, 2024Updated last year
- A small python library that can clump lists of data together.☆149Nov 30, 2021Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- a deduplication tool☆17Jul 27, 2019Updated 7 years ago
- Learning BPE embeddings by first learning a segmentation model and then training word2vec☆19Dec 18, 2022Updated 3 years ago
- ☆17Jul 14, 2024Updated 2 years ago
- A powerful and modular toolkit for record linkage and duplicate detection in Python☆1,059Feb 21, 2024Updated 2 years ago
- GLADIS: A General and Large Acronym Disambiguation Benchmark (EACL 23)☆18Jun 24, 2024Updated 2 years ago
- The package provides base classes and utils for flake8 plugin writing☆18Jan 1, 2024Updated 2 years ago
- Dictionary of obscure words☆12Aug 15, 2023Updated 2 years ago
- Tutorial on probabilistic classification and cost-sensitive learning.☆13Jul 22, 2026Updated 2 weeks ago
- Get a list of deduped files on a ZFS filesystem☆13Oct 14, 2020Updated 5 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆11Feb 26, 2021Updated 5 years ago
- A Python tool to search for and remove duplicated files in messy datasets☆15Dec 23, 2024Updated last year
- Natural Intelligence is still a pretty good idea.☆834Mar 9, 2026Updated 5 months ago
- Extra blocks for scikit-learn pipelines.☆1,408Updated this week
- ☆25Jul 9, 2024Updated 2 years ago
- ☆20Mar 30, 2022Updated 4 years ago
- A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.☆4,498Jul 29, 2025Updated last year
- Fast fuzzy text search☆12May 16, 2023Updated 3 years ago
- Learning Semantically Structured Text and Sentence Embeddings☆71Mar 9, 2026Updated 5 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 🎨 William Morris colour palettes for ggplot2 🎨☆21Feb 17, 2021Updated 5 years ago
- Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.☆67Updated this week
- Official implementation of "Traveling Waves Encode the Recent Past and Enhance Sequence Learning" (ICLR 2024)☆12Mar 15, 2024Updated 2 years ago
- A Polars plugin for encrypting and decrypting data using AES-GSM-CIV algorithm in Rust☆11Jan 8, 2025Updated last year
- `arrowspace` for Python. A graph analysis and vector search library☆16Aug 4, 2026Updated last week
- String deduplication package for Go☆19Jan 10, 2024Updated 2 years ago
- Generate reports for spaCy models.☆29May 27, 2022Updated 4 years ago