Alternatives and similar repositories for detdup

Users that are interested in detdup are comparing it to the libraries listed below

• Tony-Wang / YaYaNLP
  Pure python NLP toolkit
  ☆55Updated 9 years ago
• JoeWoo / tyccl
  tyccl(同义词词林) is a ruby gem that provides friendly functions to analyse similarity between Chinese Words.
  ☆46Updated 11 years ago
• binhe22 / pullword
  A Python package for pullword.com
  ☆86Updated 5 years ago
• guokr / gkseg
  Yet another Chinese word segmentation package based on character-based tagging heuristics and CRF algorithm
  ☆245Updated 12 years ago
• NLPchina / miniseg
  A Chinese Words Segmentation Tool Based on Bayes Model
  ☆79Updated 12 years ago
• dchentech / detdup
  Detect duplicated items framework。内容排重框架。
  ☆12Updated 10 years ago
• fxsjy / finalseg
  Chinese Words Segment Library based on HMM model
  ☆166Updated 11 years ago
• jannson / yaha
  yaha
  ☆267Updated 7 years ago
• ferventdesert / tnpy
  a text analyzing (match, rewrite, extract) engine (python edition)
  ☆80Updated 8 years ago
• NLeSC / xtas
  Distributed text analysis suite based on Celery
  ☆96Updated 3 years ago
• likehua / search-engine
  ☆68Updated 10 years ago
• duanhongyi / genius
  a chinese segment base on crf
  ☆234Updated 7 years ago
• guokr / Caver
  Caver: a toolkit for multilabel text classification.
  ☆39Updated 6 years ago
• tpeng / weibosearch
  A distributed Sina Weibo Search spider base on Scrapy and Redis.
  ☆145Updated 12 years ago
• yesseecity / hanlp-python
  把之前 hanLP-python-flask 裡面的 hanLP 單獨分出來
  ☆59Updated 8 years ago
• JNU-MINT / TextBayesClassifier
  ☆100Updated 11 years ago
• taozhijiang / chinese_nlp
  Chinese Natural Language Processing tools and examples
  ☆162Updated 9 years ago
• milkcat / MilkCat
  中文自然语言处理工具包
  ☆86Updated 10 years ago
• joeywen / fudannlp
  复旦的中文自然语言工具包
  ☆71Updated 8 years ago
• panyang / MeCab-Chinese
  Chinese morphological analysis with Word Segment and POS Tagging data for MeCab
  ☆162Updated 8 years ago
• archerhu / scel2mmseg
  convert sogou input dict ( .scel file ) to mmseg(coreseek) dict
  ☆96Updated 12 years ago
• GeorgeBourne / grid
  Chinese Tokenizer; New words Finder. 中文三段式机械分词算法; 未登录新词发现算法
  ☆95Updated 9 years ago
• jannson / wordmaker
  auto generate chinese words in huge text.
  ☆92Updated 11 years ago
• 2shou / python-libshorttext
  An easy-install script for LibShortText
  ☆27Updated 11 years ago
• fengli / autocomplete-redis
  autocomplete-redis is a quora like automatic autocompletion based on redis.
  ☆204Updated 12 years ago
• outerWorld / snail
  framework for data mining, and c++ language used.
  ☆23Updated 12 years ago
• prozhuchen / 2016CCF-sougou
  2016CCF-sougou-code&PPT
  ☆56Updated 9 years ago
• bosondata / bosonnlp.py
  BosonNLP HTTP API 封装库（SDK）
  ☆163Updated 7 years ago
• xccds / chinese_wordseg_keras
  基于深度学习的中文分词尝试
  ☆84Updated 10 years ago
• fangpenlin / loso
  Chinese segmentation library
  ☆83Updated 14 years ago