Alternatives and similar repositories for fastlangid

Users that are interested in fastlangid are comparing it to the libraries listed below

• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆88Updated 3 years ago
• oscar-project / goclassy
  An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.
  ☆86Updated 4 years ago
• aboSamoor / pycld2
  ☆178Updated 10 months ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆34Updated 5 months ago
• kpu / preprocess
  Corpus preprocessing
  ☆99Updated last year
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆33Updated last year
• bjascob / pyInflect
  A python module for word inflections designed for use with spaCy.
  ☆93Updated 6 years ago
• bsolomon1124 / pycld3
  Python3 bindings for the Compact Language Detector v3 (CLD3)
  ☆155Updated 2 years ago
• ChenghaoMou / embeddings
  zero-vocab or low-vocab embeddings
  ☆18Updated 3 years ago
• AU-DIS / LSTM_langid
  Source code for the Apple reproduction
  ☆33Updated 4 years ago
• SYSTRAN / similarity
  Bilingual sentence similarity classifier using Tensorflow
  ☆24Updated 6 years ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 5 years ago
• snukky / wikiedits
  Automatic extraction of edited sentences from text edition histories.
  ☆83Updated 3 years ago
• tofunlp / sister
  SImple SenTence EmbeddeR
  ☆74Updated 2 years ago
• pmbaumgartner / spacy-setfit-textcat
  ☆30Updated 3 years ago
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆115Updated this week
• indix / whatthelang
  Lightning Fast Language Prediction 🚀
  ☆167Updated 5 months ago
• SYSTRAN / fuzzy-match
  Library and command line utility to do approximate string matching of a source against a bitext index and get matched source and target.
  ☆51Updated 9 months ago
• transducens / linguacrawl
  Crawling engine that crawls a set of top-level domains looking for documents in a list of languages
  ☆11Updated 2 years ago
• ghaddarAbs / WiNER
  ☆32Updated 4 years ago
• shyyhs / CourseraParallelCorpusMining
  Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation
  ☆15Updated last year
• Helsinki-NLP / OpusTools
  ☆81Updated last week
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆160Updated last year
• nttcslab-nlp / spanalign
  SpanAlign: Sentence Alignment Method based on Cross-Language Span Prediction and ILP
  ☆14Updated 4 years ago
• lunayach / visNER
  In the wild extraction of entities that are found using Flair and displayed using a very elegant front-end.
  ☆71Updated 3 years ago
• clab / wikipedia-parallel-titles
  Tools for extracting parallel corpora from article titles across languages in Wikipedia
  ☆74Updated 10 years ago
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆57Updated 4 months ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated last month
• thomasthiebaud / spacy-fastlang
  Language detection using Spacy and Fasttext
  ☆57Updated 2 years ago
• jwieting / para-nmt-50m
  Pre-trained models and code and data to train and use models from "Pushing the Limits of Paraphrastic Sentence Embeddings with Millions o…
  ☆103Updated 2 years ago