Alternatives and similar repositories for detdup

Users that are interested in detdup are comparing it to the libraries listed below

• JoeWoo / tyccl
  tyccl(同义词词林) is a ruby gem that provides friendly functions to analyse similarity between Chinese Words.
  ☆46Updated 11 years ago
• binhe22 / pullword
  A Python package for pullword.com
  ☆86Updated 5 years ago
• Tony-Wang / YaYaNLP
  Pure python NLP toolkit
  ☆55Updated 9 years ago
• guokr / gkseg
  Yet another Chinese word segmentation package based on character-based tagging heuristics and CRF algorithm
  ☆245Updated 12 years ago
• NLeSC / xtas
  Distributed text analysis suite based on Celery
  ☆96Updated 2 years ago
• fxsjy / finalseg
  Chinese Words Segment Library based on HMM model
  ☆166Updated 11 years ago
• ferventdesert / tnpy
  a text analyzing (match, rewrite, extract) engine (python edition)
  ☆80Updated 8 years ago
• yesseecity / hanlp-python
  把之前 hanLP-python-flask 裡面的 hanLP 單獨分出來
  ☆59Updated 7 years ago
• duanhongyi / genius
  a chinese segment base on crf
  ☆234Updated 6 years ago
• milkcat / MilkCat
  中文自然语言处理工具包
  ☆86Updated 10 years ago
• jannson / yaha
  yaha
  ☆267Updated 6 years ago
• JNU-MINT / TextBayesClassifier
  ☆99Updated 11 years ago
• tpeng / weibosearch
  A distributed Sina Weibo Search spider base on Scrapy and Redis.
  ☆144Updated 12 years ago
• NLPchina / miniseg
  A Chinese Words Segmentation Tool Based on Bayes Model
  ☆79Updated 12 years ago
• pluskid / pymmseg-cpp
  rmmseg-cpp with Python interface
  ☆189Updated 11 years ago
• guokr / Caver
  Caver: a toolkit for multilabel text classification.
  ☆39Updated 6 years ago
• jannson / wordmaker
  auto generate chinese words in huge text.
  ☆92Updated 10 years ago
• likehua / search-engine
  ☆68Updated 10 years ago
• fengli / autocomplete-redis
  autocomplete-redis is a quora like automatic autocompletion based on redis.
  ☆204Updated 11 years ago
• lijiancheng0614 / scikit-learn
  scikit-learn-doc-zh
  ☆16Updated 9 years ago
• solarlee / Awesome-Python-Toolbox
  ☆56Updated 9 years ago
• GeorgeBourne / grid
  Chinese Tokenizer; New words Finder. 中文三段式机械分词算法; 未登录新词发现算法
  ☆95Updated 8 years ago
• dchentech / detdup
  Detect duplicated items framework。内容排重框架。
  ☆12Updated 10 years ago
• pelick / VerticleSearchEngine
  Academic Search Engine using Scrapy, MongoDB, Lucene/Solr, Tika, Struts2, Jquery, Bootstrap, D3, CAS
  ☆100Updated 12 years ago
• archerhu / scel2mmseg
  convert sogou input dict ( .scel file ) to mmseg(coreseek) dict
  ☆96Updated 12 years ago
• bosondata / bosonnlp.py
  BosonNLP HTTP API 封装库（SDK）
  ☆163Updated 6 years ago
• baojie / leansemanticweb
  Lean Semantic Web tutorials
  ☆128Updated 11 years ago
• taozhijiang / chinese_nlp
  Chinese Natural Language Processing tools and examples
  ☆162Updated 9 years ago
• yingrui / mahjong
  开源中文分词工具包，中文分词Web API，Lucene中文分词，中英文混合分词
  ☆43Updated 4 years ago
• g2384 / chi-syn
  Chinese Synonym Library
  ☆123Updated 7 years ago