Alternatives and similar repositories for detdup:

Users that are interested in detdup are comparing it to the libraries listed below

• JoeWoo / tyccl
  tyccl(同义词词林) is a ruby gem that provides friendly functions to analyse similarity between Chinese Words.
  ☆46Updated 11 years ago
• guokr / gkseg
  Yet another Chinese word segmentation package based on character-based tagging heuristics and CRF algorithm
  ☆242Updated 12 years ago
• NLPchina / miniseg
  A Chinese Words Segmentation Tool Based on Bayes Model
  ☆78Updated 11 years ago
• jannson / wordmaker
  auto generate chinese words in huge text.
  ☆91Updated 10 years ago
• isnowfy / snowseg
  tools for chinese word segmentation and pos tagging written in python
  ☆38Updated 11 years ago
• lepture / opencc-python
  OpenCC binding for Python.
  ☆52Updated 4 years ago
• fengli / autocomplete-redis
  autocomplete-redis is a quora like automatic autocompletion based on redis.
  ☆204Updated 11 years ago
• liuquncn / NanGeMT
  NanGe - A Rule-based Chinese-English Machine Translation System
  ☆20Updated 7 years ago
• milkcat / MilkCat
  中文自然语言处理工具包
  ☆86Updated 9 years ago
• shell909090 / python-segment
  python-segment是一个纯python实现的分词库，他的目标是提供一个可用的，完善的分词系统和训练环境，包括一个可用的词典。
  ☆16Updated 11 years ago
• Teaonly / easyCollect
  一个碎片收藏管理的工具
  ☆8Updated 6 years ago
• yingrui / mahjong
  开源中文分词工具包，中文分词Web API，Lucene中文分词，中英文混合分词
  ☆43Updated 4 years ago
• binhe22 / pullword
  A Python package for pullword.com
  ☆83Updated 4 years ago
• rebornix / hubot-scripts
  My GitHub Hubot scripts.
  ☆12Updated 9 years ago
• NLeSC / xtas
  Distributed text analysis suite based on Celery
  ☆95Updated 2 years ago
• fxsjy / finalseg
  Chinese Words Segment Library based on HMM model
  ☆167Updated 10 years ago
• riobard / PRC-RID
  Parse and extract information from a Resident Identity Card Number issued by People's Republic of China
  ☆55Updated 11 years ago
• gaocegege / scala-github-relationship
  A graphical view of the relationships between github users.
  ☆38Updated 5 years ago
• Tony-Wang / YaYaNLP
  Pure python NLP toolkit
  ☆55Updated 9 years ago
• archerhu / scel2mmseg
  convert sogou input dict ( .scel file ) to mmseg(coreseek) dict
  ☆97Updated 11 years ago
• Zehao / sogouSCEL
  搜狗输入法细胞词库解析
  ☆14Updated 11 years ago
• xpgeng / blog_of_baojie
  Some articles written by Bao Jie
  Updated 8 years ago
• ferventdesert / tnpy
  a text analyzing (match, rewrite, extract) engine (python edition)
  ☆80Updated 7 years ago
• lzjun567 / html-extractor
  《基于行块分布函数的通用网页正文抽取》的Python实现方式
  ☆30Updated 10 years ago
• joeywen / fudannlp
  复旦的中文自然语言工具包
  ☆69Updated 7 years ago
• nanjunxiao / tag_doc_with_lda
  tag doc using topN words with lda
  ☆10Updated 9 years ago
• ryancheunggit / Expression_of_Emotions_in_20th_Century_Chinese_Books
  Sentiment Analysis on Google's Chinese 1gram dataset
  ☆15Updated 7 years ago
• dchentech / detdup
  Detect duplicated items framework。内容排重框架。
  ☆12Updated 9 years ago
• soimort-bot / you-get.bot
  ☆21Updated 6 years ago
• PyChina / CPyUG
  已停止,迁移为 https://github.com/PyChina/blog
  ☆10Updated 8 years ago