Alternatives and similar repositories for fastlangid

Users that are interested in fastlangid are comparing it to the libraries listed below

• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆30Updated 4 months ago
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆33Updated 11 months ago
• pmbaumgartner / spacy-setfit-textcat
  ☆30Updated 2 years ago
• uhh-lt / targer
  A web application tagging and retrieval of arguments in text
  ☆29Updated 2 years ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 5 years ago
• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆88Updated 2 years ago
• mingruimingrui / fast-mosestokenizer
  c++ mosestokenizer
  ☆18Updated last year
• shyyhs / CourseraParallelCorpusMining
  Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation
  ☆14Updated 9 months ago
• bsolomon1124 / pycld3
  Python3 bindings for the Compact Language Detector v3 (CLD3)
  ☆153Updated last year
• intfloat / uts
  python package for unsupervised text segmentation.
  ☆14Updated 8 years ago
• webis-de / summary-explorer
  Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.
  ☆44Updated last year
• zaemyung / sentsplit
  A flexible sentence segmentation library using CRF model and regex rules
  ☆29Updated last year
• AU-DIS / LSTM_langid
  Source code for the Apple reproduction
  ☆32Updated 4 years ago
• stephantul / reach
  Load embeddings and featurize your sentences.
  ☆30Updated 7 months ago
• LightTag / sequence-labeling-with-transformers
  Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models
  ☆65Updated 2 years ago
• stephantul / piecelearn
  Learning BPE embeddings by first learning a segmentation model and then training word2vec
  ☆19Updated 2 years ago
• MartinoMensio / spacy-sentence-bert
  Sentence transformers models for SpaCy
  ☆107Updated 2 years ago
• octanove / grammartagger
  GrammarTagger — A Neural Multilingual Grammar Profiler for Language Learning
  ☆27Updated 4 years ago
• snukky / wikiedits
  Automatic extraction of edited sentences from text edition histories.
  ☆83Updated 3 years ago
• aboSamoor / pycld2
  ☆171Updated 2 months ago
• bjascob / pyInflect
  A python module for word inflections designed for use with spaCy.
  ☆92Updated 5 years ago
• stephantul / unitoken
  Tokenization across languages. Useful as preprocessing for subword tokenization.
  ☆22Updated 2 years ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated 8 months ago
• cfournie / segmentation.evaluation
  SegEval Segmentation Evaluation Package
  ☆56Updated last year
• transducens / linguacrawl
  Crawling engine that crawls a set of top-level domains looking for documents in a list of languages
  ☆11Updated last year
• Kaleidophon / token2index
  A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …
  ☆51Updated 6 months ago
• ghaddarAbs / WiNER
  ☆33Updated 3 years ago
• oscar-project / goclassy
  An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.
  ☆86Updated 4 years ago
• babylonhealth / hmrb
  ☆70Updated 2 years ago
• thomasthiebaud / spacy-fastlang
  Language detection using Spacy and Fasttext
  ☆55Updated last year