Alternatives and similar repositories for dedup

Users that are interested in dedup are comparing it to the libraries listed below

• flexudy-pipe / sentence-doctor
  Many Natural Language Processing tasks rely on sentence boundary detection (SBD). Although amazing libraries like spacy provide state of …
  ☆62Updated 5 years ago
• transducens / linguacrawl
  Crawling engine that crawls a set of top-level domains looking for documents in a list of languages
  ☆11Updated last year
• Helsinki-NLP / sentimentator
  Tool for sentiment analysis annotation
  ☆13Updated 9 months ago
• vincent9514 / Text-Variant-Generation
  📄Neural Sentential Paraphrase Generation to Augment Chatbot Training Dataset
  ☆21Updated 3 years ago
• ilinguistics / common_crawl_corpus
  Scripts for building a geo-located web corpus using Common Crawl data
  ☆11Updated 2 months ago
• openredact / nerwhal
  This is a prototype of a multi-lingual suite for named-entity recognition in Python.
  ☆21Updated last year
• alexyorke / butter-fingers
  A python library to generate highly realistic typos (fuzz-testing)
  ☆13Updated 9 months ago
• BramVanroy / spacy-extreme
  An example of how to use spaCy for extremely large files without running into memory issues
  ☆36Updated 3 years ago
• ad-freiburg / tokenization-repair
  Correction of spaces with character-based neural language models.
  ☆13Updated 3 years ago
• amansrivastava17 / text-preprocess-python
  Text preprocessing tools in python.
  ☆27Updated 7 years ago
• fionapigott / conversation-builder
  Python script to assemble individual Tweets from a public Twitter stream (either Gnip activity-streams format or original Twitter API for…
  ☆12Updated 9 years ago
• sahyagiri / DistinctKeywords
  semantically distinct key phrase extraction using hilbert hashes.
  ☆50Updated 3 years ago
• xigt / freki
  Analyze XML extracted from PDFs (e.g. from TET or PDFMiner)
  ☆20Updated 8 years ago
• prakhar21 / Automatic-Glossary-Generation
  The projects lets you extract glossary words and their definitions from a given piece of text automatically using NLP techniques
  ☆29Updated 5 years ago
• domyounglee / TF-TrigramBlocking-transformer
  Transformer based Trigram Blocking implementation in Tensorflow
  ☆11Updated 5 years ago
• aostuni / Ethics-of-AI-ML
  Materials and Information for Ethics of Artificial Intelligence and Machine Learning
  ☆11Updated 2 years ago
• TyMick / loan-risk-neural-network
  Loan Risk Prediction Neural Network and API
  ☆17Updated 5 years ago
• DanielJDufour / date-extractor
  Extract dates from text
  ☆66Updated 4 years ago
• explosion / spacy-vectors-builder
  🌸 Train floret vectors
  ☆18Updated 2 years ago
• argilla-io / biome-text
  Custom Natural Language Processing with big and small models 🌲🌱
  ☆66Updated 4 years ago
• andrewtavis / wikirepo
  Python based Wikidata framework for easy dataframe extraction
  ☆45Updated 2 years ago
• deeppavlov / dp_tutorials
  ☆33Updated 6 years ago
• dataiku / dss-plugin-nlp-preparation
  Dataiku DSS plugin to detect languages, correct misspellings, and clean text data 🧼
  ☆22Updated 11 months ago
• tokestermw / spacy_kenlm
  KenLM extension for spaCy 2.0.
  ☆16Updated 8 years ago
• maxent-ai / zeroshot_topics
  Topic Inference with Zeroshot models
  ☆61Updated 2 years ago
• TurkuNLP / ocr-correction
  Post-processing OCR errors with seq2seq models
  ☆28Updated 5 years ago
• modernmt / DataCollection
  Data collection, alignment and TAUS repository
  ☆23Updated 8 years ago
• huggingface / adversarialnlp
  A generic library for crafting adversarial NLP examples - WIP
  ☆41Updated 7 years ago
• bigartm / visartm
  ☆18Updated 7 years ago
• krandiash / gpt3-nli
  Training a model without a dataset for natural language inference (NLI)
  ☆25Updated 5 years ago