dedupeio / dedupe

Related projects ⓘ

Alternatives and complementary repositories for dedupe

• dedupeio / dedupe-examples
  Examples for using the dedupe library
  ☆406Updated 3 months ago
• J535D165 / recordlinkage
  A powerful and modular toolkit for record linkage and duplicate detection in Python
  ☆967Updated 9 months ago
• jamesturk / jellyfish
  🪼 a python library for doing approximate and phonetic matching of strings.
  ☆2,068Updated 3 weeks ago
• datamade / usaddress
  a python library for parsing unstructured United States address strings into address components
  ☆1,532Updated last month
• datamade / parserator
  A toolkit for making domain-specific probabilistic parsers
  ☆797Updated last month
• chartbeat-labs / textacy
  NLP, before and after spaCy
  ☆2,217Updated last year
• datamade / probablepeople
  a python library for parsing unstructured western names into name components.
  ☆593Updated 3 weeks ago
• dedupeio / csvdedupe
  Command line tool for deduplicating CSV files
  ☆413Updated 4 years ago
• explosion / sense2vec
  🦆 Contextually-keyed word vectors
  ☆1,625Updated 8 months ago
• explosion / thinc
  🔮 A refreshing functional take on deep learning, compatible with your favorite libraries
  ☆2,820Updated last month
• DerwenAI / pytextrank
  Python implementation of TextRank algorithms ("textgraphs") for phrase extraction
  ☆2,150Updated 4 months ago
• J535D165 / data-matching-software
  A list of free data matching and record linkage software.
  ☆362Updated 9 months ago
• clips / pattern
  Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
  ☆8,753Updated 5 months ago
• snorkel-team / snorkel
  A system for quickly generating training data with weak supervision
  ☆5,812Updated 6 months ago
• piskvorky / smart_open
  Utils for streaming large files (S3, HDFS, gzip, bz2...)
  ☆3,215Updated 3 weeks ago
• openvenues / pypostal
  Python bindings to libpostal for fast international address parsing/normalization
  ☆767Updated 4 months ago
• seatgeek / fuzzywuzzy
  Fuzzy String Matching in Python
  ☆9,229Updated last year
• life4 / textdistance
  📐 Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.
  ☆3,395Updated 2 months ago
• hi-primus / optimus
  Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
  ☆1,481Updated this week
• blaze / blaze
  NumPy and Pandas interface to Big Data
  ☆3,187Updated last year
• deanmalmgren / textract
  extract text from any document. no muss. no fuss.
  ☆3,910Updated this week
• petl-developers / petl
  Python Extract Transform and Load Tables of Data
  ☆1,250Updated 6 months ago
• rspeer / python-ftfy
  Fixes mojibake and other glitches in Unicode text, after the fact.
  ☆3,816Updated 3 weeks ago
• moj-analytical-services / splink
  Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
  ☆1,385Updated this week
• mit-nlp / MITIE
  MITIE: library and tools for information extraction
  ☆2,922Updated 2 years ago
• airbnb / knowledge-repo
  A next-generation curated knowledge sharing platform for data scientists and other technical professions.
  ☆5,482Updated 2 months ago
• anhaidgroup / deepmatcher
  Python package for performing Entity and Text Matching using Deep Learning.
  ☆566Updated 5 months ago
• wireservice / agate
  A Python data analysis library that is optimized for humans instead of machines.
  ☆1,173Updated 3 months ago
• vi3k6i5 / flashtext
  Extract Keywords from sentence or Replace keywords in sentences.
  ☆5,597Updated 4 months ago
• openeventdata / mordecai
  Full text geoparsing as a Python library
  ☆742Updated 3 years ago