Alternatives and similar repositories for near-dup-detection

Users that are interested in near-dup-detection are comparing it to the libraries listed below

• ContinuumIO / topik
  A Topic Modeling toolbox
  ☆92Updated 9 years ago
• bdewilde / pygotham_2016
  code and slides for my PyGotham 2016 talk, "Higher-level Natural Language Processing with textacy"
  ☆15Updated 8 years ago
• semanticize / semanticizer
  Entity Linking for the masses
  ☆56Updated 9 years ago
• mewwts / feng
  feng - feature engineering for machine-learning champions
  ☆27Updated 8 years ago
• piskvorky / sim-shootout
  Code for "Performance shootout between nearest-neighbour libraries": http://radimrehurek.com/2013/11/performance-shootout-of-nearest-neig…
  ☆99Updated 9 years ago
• anthonygarvan / MinHash
  ☆24Updated 7 years ago
• bkj / wit
  Algorithms for "schema matching"
  ☆26Updated 8 years ago
• dask / old-dask-examples
  Collection of dask example notebooks
  ☆58Updated 7 years ago
• willf / segment
  A tool to segment text based on frequencies and the Viterbi algorithm "#TheBoyWhoLived" => ['#', 'The', 'Boy', 'Who', 'Lived']
  ☆81Updated 9 years ago
• honnibal / text_classification
  Relatively simple text classification powered by spaCy
  ☆41Updated 9 years ago
• Parsely / probably
  Probabilistic Data Structures in Python (originally presented at PyData 2013)
  ☆55Updated 3 years ago
• arnicas / nlp_elasticsearch_reviews
  Dato/Turi DS Conf talk on NLP and Elasticsearch analysis of reviews, plus JS implementation
  ☆45Updated 8 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 2 years ago
• aaronbenz / caspanda
  Using Pandas easily with Cassandra
  ☆23Updated 7 years ago
• piskvorky / gensim-simserver
  [NO LONGER MAINTAINED AS OPEN SOURCE - USE SCALETEXT.COM INSTEAD]
  ☆108Updated 11 years ago
• DeaconDesperado / flask_mab
  An implementation of the multi-armed bandit optimization pattern as a Flask extension
  ☆81Updated last month
• stitchfix / context2vec
  Using Word2Vec on lists and sets
  ☆34Updated 9 years ago
• columbia-applied-data-science / rosetta
  Tools, wrappers, etc... for data science with a concentration on text processing
  ☆206Updated 2 years ago
• dwhitena / dockerized-DS-python
  A simple example of containerized data science with python and Docker.
  ☆51Updated 7 years ago
• trec-kba / streamcorpus
  common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text
  ☆35Updated 8 years ago
• DistrictDataLabs / baleen
  An automated ingestion service for blogs to construct a corpus for NLP research.
  ☆87Updated 6 years ago
• ClimbsRocks / empythy
  Automated NLP sentiment predictions- batteries included, or use your own data
  ☆18Updated 7 years ago
• saffsd / wikidump
  Tools to manipulate and extract data from wikipedia dumps
  ☆46Updated 11 years ago
• proycon / python-ucto
  This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet…
  ☆29Updated 5 months ago
• dedupeio / affinegap
  A Cython implementation of the affine gap string distance
  ☆57Updated 2 years ago
• zelandiya / KiwiPyCon-NLP-tutorial
  Code examples and data for the KiwiPyCon 2014 NLP tutorial
  ☆39Updated 10 years ago
• semanticize / st
  Semanticizest: dump parser and client
  ☆20Updated 9 years ago
• amplab / ampcrowd
  A RESTful web service that runs microtasks across multiple crowds, provides quality control techniques, and is easily extensible.
  ☆51Updated 7 years ago
• DeNeutoy / spacy-vis
  A visualisation tool for Spacy using Hierplane.
  ☆65Updated 2 years ago
• AWNystrom / DiskDict
  A disk-based key/value store in Python with no dependencies.
  ☆21Updated 10 years ago