dedupeio / csvdedupe
Command line tool for deduplicating CSV files
☆420Updated 5 years ago
Alternatives and similar repositories for csvdedupe:
Users that are interested in csvdedupe are comparing it to the libraries listed below
- Examples for using the dedupe library☆411Updated 8 months ago
- a python library for parsing unstructured western names into name components.☆606Updated 6 months ago
- A list of free data matching and record linkage software.☆382Updated last year
- Resources for tackling record linkage / deduplication / data matching problems☆123Updated last year
- A powerful and modular toolkit for record linkage and duplicate detection in Python☆1,001Updated last year
- Parser and standardizer for politician, individual and organization names.☆129Updated 7 years ago
- A toolkit for making domain-specific probabilistic parsers☆800Updated 7 months ago
- Framework and command-line tools for integrating FollowTheMoney data streams from multiple sources☆210Updated last week
- Tools for parsing messy tabular data. This is now superseded by https://github.com/frictionlessdata/tabulator-py☆389Updated last year
- Record linking package that fuzzy matches two Python pandas dataframes using sqlite3 fts4☆283Updated 2 years ago
- Clean US addresses following USPS pub 28 and RESO guidelines☆216Updated last year
- A CSV file with US given names (first name) and their associated nicknames or diminutive names.☆298Updated 6 months ago
- Simplifies use of the Dedupe library via Pandas☆136Updated 2 years ago
- Make it easier to compare and cross-reference the names of companies and people by applying strong normalisation.☆151Updated 3 months ago
- a python library for parsing unstructured United States address strings into address components☆1,563Updated this week
- A Python library for working with Table Schema.☆263Updated 5 months ago
- Clean personally identifiable information from dirty dirty text.☆406Updated last year
- Tools for generating CSV and other flat versions of the structured data☆107Updated this week
- 🔎 Finds fuzzy matches between CSV files☆189Updated last month
- A simple command line interface to the datamade/dedupe library.☆42Updated 2 years ago
- Dedupe/batch geocode addresses and venues around the world with libpostal☆82Updated 3 years ago
- Group thousands of similar spreadsheet or database text entries in seconds☆155Updated last year
- A package for easily working with US and state metadata☆498Updated 9 months ago
- Python scripts to parse U.S. voter files☆119Updated 4 years ago
- Making Data, the DataMade Way☆292Updated 4 years ago
- Predict age and gender from a first name☆60Updated 6 years ago
- Extracts key terminology (n-grams) from any large collection of documents (>1000) and forecasts emergence☆64Updated last year
- A lightweight server to allow HTTP requests to the Stanford Named Entity Recognized and a heavily modified CLAVIN geoparser.☆119Updated 2 years ago
- Python library for reading and writing tabular data via streams.☆237Updated 3 years ago
- Python script for matching a list of messy addresses against a gazetteer using dedupe.☆63Updated 5 years ago