Alternatives and similar repositories for detdup

Users that are interested in detdup are comparing it to the libraries listed below

• JoeWoo / tyccl
  tyccl(同义词词林) is a ruby gem that provides friendly functions to analyse similarity between Chinese Words.
  ☆46Updated 11 years ago
• guokr / gkseg
  Yet another Chinese word segmentation package based on character-based tagging heuristics and CRF algorithm
  ☆245Updated 12 years ago
• binhe22 / pullword
  A Python package for pullword.com
  ☆86Updated 5 years ago
• NLeSC / xtas
  Distributed text analysis suite based on Celery
  ☆96Updated 2 years ago
• fxsjy / finalseg
  Chinese Words Segment Library based on HMM model
  ☆166Updated 11 years ago
• ferventdesert / tnpy
  a text analyzing (match, rewrite, extract) engine (python edition)
  ☆80Updated 8 years ago
• Tony-Wang / YaYaNLP
  Pure python NLP toolkit
  ☆55Updated 9 years ago
• NLPchina / miniseg
  A Chinese Words Segmentation Tool Based on Bayes Model
  ☆79Updated 12 years ago
• solarlee / Awesome-Python-Toolbox
  ☆56Updated 9 years ago
• tpeng / weibosearch
  A distributed Sina Weibo Search spider base on Scrapy and Redis.
  ☆144Updated 12 years ago
• jannson / yaha
  yaha
  ☆267Updated 7 years ago
• dchentech / detdup
  Detect duplicated items framework。内容排重框架。
  ☆12Updated 10 years ago
• duanhongyi / genius
  a chinese segment base on crf
  ☆234Updated 6 years ago
• JNU-MINT / TextBayesClassifier
  ☆99Updated 11 years ago
• yesseecity / hanlp-python
  把之前 hanLP-python-flask 裡面的 hanLP 單獨分出來
  ☆59Updated 7 years ago
• likehua / search-engine
  ☆68Updated 10 years ago
• seomoz / simhash-cluster
  A cluster implementation of simhash near-duplicate detection
  ☆32Updated 10 years ago
• joeywen / fudannlp
  复旦的中文自然语言工具包
  ☆72Updated 8 years ago
• chocoluffy / DL4NLP
  Deep Learning for NLP resources
  ☆17Updated 10 years ago
• GeorgeBourne / grid
  Chinese Tokenizer; New words Finder. 中文三段式机械分词算法; 未登录新词发现算法
  ☆95Updated 9 years ago
• jannson / wordmaker
  auto generate chinese words in huge text.
  ☆92Updated 10 years ago
• bosondata / bosonnlp.py
  BosonNLP HTTP API 封装库（SDK）
  ☆163Updated 6 years ago
• 2shou / python-libshorttext
  An easy-install script for LibShortText
  ☆27Updated 10 years ago
• pluskid / pymmseg-cpp
  rmmseg-cpp with Python interface
  ☆189Updated 11 years ago
• taozhijiang / chinese_nlp
  Chinese Natural Language Processing tools and examples
  ☆162Updated 9 years ago
• wwj718 / deepThought
  deepThought is a conversational smart bot
  ☆109Updated 9 years ago
• python-recsys / crab
  Crab is a flexible, fast recommender engine for Python that integrates classic information filtering recommendation algorithms in the world…
  ☆128Updated 12 years ago
• tobegit3hub / tobe-algorithm-manual
  Tobe Algorithm Manual
  ☆48Updated 5 years ago
• djsensei / AlwaysRemember
  Zipfian capstone project - Dan Morris
  ☆30Updated 8 years ago
• fxsjy / jiebademo
  a demo site for jieba
  ☆111Updated 12 years ago