Alternatives and similar repositories for dedupe

Users that are interested in dedupe are comparing it to the libraries listed below

• J535D165 / recordlinkage
  A powerful and modular toolkit for record linkage and duplicate detection in Python
  ☆1,027Updated last year
• dedupeio / dedupe-examples
  Examples for using the dedupe library
  ☆415Updated last year
• datamade / usaddress
  a python library for parsing unstructured United States address strings into address components
  ☆1,604Updated 3 months ago
• dedupeio / csvdedupe
  Command line tool for deduplicating CSV files
  ☆431Updated 5 years ago
• datamade / parserator
  A toolkit for making domain-specific probabilistic parsers
  ☆806Updated last year
• datamade / probablepeople
  a python library for parsing unstructured western names into name components.
  ☆609Updated 5 months ago
• jamesturk / jellyfish
  🪼 a python library for doing approximate and phonetic matching of strings.
  ☆2,166Updated 2 weeks ago
• openvenues / pypostal
  Python bindings to libpostal for fast international address parsing/normalization
  ☆850Updated last week
• chartbeat-labs / textacy
  NLP, before and after spaCy
  ☆2,235Updated 2 years ago
• DerwenAI / pytextrank
  Python implementation of TextRank algorithms ("textgraphs") for phrase extraction
  ☆2,203Updated last month
• J535D165 / data-matching-software
  A list of free data matching and record linkage software.
  ☆394Updated last year
• hi-primus / optimus
  Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
  ☆1,524Updated 11 months ago
• snorkel-team / snorkel
  A system for quickly generating training data with weak supervision
  ☆5,921Updated last year
• bmabey / pyLDAvis
  Python library for interactive topic model visualization. Port of the R LDAvis package.
  ☆1,843Updated last year
• chrismattmann / tika-python
  Tika-Python is a Python binding to the Apache Tika™ REST services allowing Tika to be called natively in the Python community.
  ☆1,629Updated 7 months ago
• openvenues / libpostal
  A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.
  ☆4,637Updated 3 weeks ago
• life4 / textdistance
  📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.
  ☆3,501Updated 6 months ago
• rspeer / python-ftfy
  Fixes mojibake and other glitches in Unicode text, after the fact.
  ☆3,982Updated last year
• moj-analytical-services / splink
  Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
  ☆1,767Updated this week
• deanmalmgren / textract
  extract text from any document. no muss. no fuss.
  ☆4,357Updated 11 months ago
• HazyResearch / deepdive
  DeepDive
  ☆1,973Updated 3 years ago
• vi3k6i5 / flashtext
  Extract Keywords from sentence or Replace keywords in sentences.
  ☆5,681Updated 7 months ago
• openeventdata / mordecai
  Full text geoparsing as a Python library
  ☆753Updated 4 years ago
• scrapinghub / extruct
  Extract embedded metadata from HTML markup
  ☆935Updated last month
• python-bonobo / bonobo
  Extract Transform Load for Python 3.5+
  ☆1,605Updated 2 years ago
• wireservice / agate
  A Python data analysis library that is optimized for humans instead of machines.
  ☆1,194Updated this week
• JasonKessler / scattertext
  Beautiful visualizations of how language differs among document types.
  ☆2,323Updated 6 months ago
• petl-developers / petl
  Python Extract Transform and Load Tables of Data
  ☆1,297Updated 3 months ago
• psolin / cleanco
  Company Name Processor written in Python
  ☆345Updated last year
• clips / pattern
  Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
  ☆8,840Updated last year