Alternatives and similar repositories for dedupe:

Users that are interested in dedupe are comparing it to the libraries listed below

• J535D165 / recordlinkage
  A powerful and modular toolkit for record linkage and duplicate detection in Python
  ☆984Updated last year
• dedupeio / csvdedupe
  Command line tool for deduplicating CSV files
  ☆419Updated 4 years ago
• datamade / usaddress
  a python library for parsing unstructured United States address strings into address components
  ☆1,559Updated last month
• seatgeek / fuzzywuzzy
  Fuzzy String Matching in Python
  ☆9,246Updated 2 years ago
• J535D165 / data-matching-software
  A list of free data matching and record linkage software.
  ☆378Updated last year
• chartbeat-labs / textacy
  NLP, before and after spaCy
  ☆2,216Updated last year
• explosion / sense2vec
  🦆 Contextually-keyed word vectors
  ☆1,640Updated 11 months ago
• openvenues / pypostal
  Python bindings to libpostal for fast international address parsing/normalization
  ☆790Updated 3 weeks ago
• datamade / probablepeople
  a python library for parsing unstructured western names into name components.
  ☆603Updated 4 months ago
• pachyderm / pachyderm
  Data-Centric Pipelines and Data Versioning
  ☆6,207Updated last month
• seatgeek / thefuzz
  Fuzzy String Matching in Python
  ☆3,087Updated this week
• JasonKessler / scattertext
  Beautiful visualizations of how language differs among document types.
  ☆2,286Updated 5 months ago
• DerwenAI / pytextrank
  Python implementation of TextRank algorithms ("textgraphs") for phrase extraction
  ☆2,170Updated 7 months ago
• jamesturk / jellyfish
  🪼 a python library for doing approximate and phonetic matching of strings.
  ☆2,104Updated 2 months ago
• ztane / python-Levenshtein
  The Levenshtein Python C extension module contains functions for fast computation of Levenshtein distance and string similarity
  ☆1,271Updated 3 years ago
• ekzhu / datasketch
  MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW
  ☆2,654Updated 9 months ago
• piskvorky / smart_open
  Utils for streaming large files (S3, HDFS, gzip, bz2...)
  ☆3,277Updated this week
• anhaidgroup / deepmatcher
  Python package for performing Entity and Text Matching using Deep Learning.
  ☆579Updated 8 months ago
• larsga / Duke
  Duke is a fast and flexible deduplication engine written in Java
  ☆619Updated last year
• Mimino666 / langdetect
  Port of Google's language-detection library to Python.
  ☆1,764Updated this week
• HazyResearch / deepdive
  DeepDive
  ☆1,959Updated 2 years ago
• datamade / parserator
  A toolkit for making domain-specific probabilistic parsers
  ☆800Updated 5 months ago
• scikit-learn-contrib / hdbscan
  A high performance implementation of HDBSCAN clustering.
  ☆2,868Updated last month
• wireservice / agate
  A Python data analysis library that is optimized for humans instead of machines.
  ☆1,178Updated last week
• rapidfuzz / RapidFuzz
  Rapid fuzzy string matching in Python using various string metrics
  ☆2,934Updated this week
• miso-belica / jusText
  Heuristic based boilerplate removal tool
  ☆754Updated last week
• aboSamoor / polyglot
  Multilingual text (NLP) processing toolkit
  ☆2,326Updated last year
• openeventdata / mordecai
  Full text geoparsing as a Python library
  ☆745Updated 3 years ago
• spotify / luigi
  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…
  ☆18,139Updated last month
• hi-primus / optimus
  Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
  ☆1,495Updated 3 months ago