Alternatives and similar repositories for detdup

Users that are interested in detdup are comparing it to the libraries listed below

• JoeWoo / tyccl
  tyccl(同义词词林) is a ruby gem that provides friendly functions to analyse similarity between Chinese Words.
  ☆46Updated 11 years ago
• binhe22 / pullword
  A Python package for pullword.com
  ☆86Updated 4 years ago
• guokr / gkseg
  Yet another Chinese word segmentation package based on character-based tagging heuristics and CRF algorithm
  ☆245Updated 12 years ago
• milkcat / MilkCat
  中文自然语言处理工具包
  ☆86Updated 10 years ago
• Teaonly / easyCollect
  一个碎片收藏管理的工具
  ☆8Updated 7 years ago
• Huangtuzhi / reality-of-Dream-of-Red-Mansions
  Comparision analysis of words use between 1 to 80 chapters and 80 to 120 chapters of 《A Dream of Red Mansions》.
  ☆76Updated 6 years ago
• lzjun567 / html-extractor
  《基于行块分布函数的通用网页正文抽取》的Python实现方式
  ☆30Updated 11 years ago
• archerhu / scel2mmseg
  convert sogou input dict ( .scel file ) to mmseg(coreseek) dict
  ☆96Updated 11 years ago
• rainyear / cix-extractor-py
  基于行块分布函数的通用网页正文（及图片）抽取 - Python版本
  ☆115Updated 8 years ago
• fengli / autocomplete-redis
  autocomplete-redis is a quora like automatic autocompletion based on redis.
  ☆204Updated 11 years ago
• dchentech / detdup
  Detect duplicated items framework。内容排重框架。
  ☆12Updated 10 years ago
• Newt0n / yapCrawler
  yet another python crawler
  ☆30Updated 11 years ago
• tobegit3hub / tobe-algorithm-manual
  Tobe Algorithm Manual
  ☆48Updated 5 years ago
• wwj718 / deepThought
  deepThought is a conversational smart bot
  ☆109Updated 8 years ago
• marchtea / mdtogh
  A small tool generates html exactly like github with TOC support.
  ☆63Updated 5 years ago
• zhengqm / SongFinder
  A spectrum analysis based music finder
  ☆107Updated 9 years ago
• tpeng / weibosearch
  A distributed Sina Weibo Search spider base on Scrapy and Redis.
  ☆145Updated 12 years ago
• riobard / PRC-RID
  Parse and extract information from a Resident Identity Card Number issued by People's Republic of China
  ☆54Updated 11 years ago
• Yaoshicn / DeepLearningFlappyFrog
  Flappy Frog hack using Deep Reinforcement Learning (Deep Q-learning). 暴力膜蛤不可取。
  ☆16Updated 8 years ago
• shipengtaov / wordcloud_web
  网页内容生成word cloud
  ☆10Updated 7 years ago
• srijiths / readabilityBUNDLE
  A bundle of html content extraction algorithms
  ☆122Updated 10 years ago
• lanbing510 / EnglishBooksEasilyReadLearn
  Read&Learn English Books Easily
  ☆25Updated 8 years ago
• likehua / search-engine
  ☆68Updated 10 years ago
• lepture / opencc-python
  OpenCC binding for Python.
  ☆52Updated 5 years ago
• liuquncn / NanGeMT
  NanGe - A Rule-based Chinese-English Machine Translation System
  ☆20Updated 7 years ago
• soimort-bot / you-get.bot
  ☆21Updated 7 years ago
• NLPchina / miniseg
  A Chinese Words Segmentation Tool Based on Bayes Model
  ☆79Updated 12 years ago
• pluskid / pymmseg-cpp
  rmmseg-cpp with Python interface
  ☆189Updated 11 years ago
• NLeSC / xtas
  Distributed text analysis suite based on Celery
  ☆96Updated 2 years ago
• pelick / VerticleSearchEngine
  Academic Search Engine using Scrapy, MongoDB, Lucene/Solr, Tika, Struts2, Jquery, Bootstrap, D3, CAS
  ☆99Updated 12 years ago