Alternatives and similar repositories for fastlangid

Users that are interested in fastlangid are comparing it to the libraries listed below

• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆33Updated last year
• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆89Updated 3 years ago
• aboSamoor / pycld2
  ☆176Updated 8 months ago
• oscar-project / goclassy
  An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.
  ☆86Updated 4 years ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆34Updated 3 months ago
• bsolomon1124 / pycld3
  Python3 bindings for the Compact Language Detector v3 (CLD3)
  ☆155Updated 2 years ago
• ChenghaoMou / embeddings
  zero-vocab or low-vocab embeddings
  ☆18Updated 3 years ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated 2 months ago
• LightTag / sequence-labeling-with-transformers
  Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models
  ☆64Updated 3 years ago
• kpu / preprocess
  Corpus preprocessing
  ☆99Updated last year
• uhh-lt / targer
  A web application tagging and retrieval of arguments in text
  ☆29Updated 2 years ago
• codogogo / towerparse
  Tower Parse: Low-Resource Dependency Parsing via Hierarchical Source Selection
  ☆15Updated 4 years ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 5 years ago
• bjascob / pyInflect
  A python module for word inflections designed for use with spaCy.
  ☆93Updated 5 years ago
• laurieburchell / open-lid-dataset
  Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)
  ☆74Updated 8 months ago
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆159Updated last year
• Helsinki-NLP / OpusTools
  ☆79Updated last week
• AU-DIS / LSTM_langid
  Source code for the Apple reproduction
  ☆32Updated 4 years ago
• shyyhs / CourseraParallelCorpusMining
  Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation
  ☆15Updated last year
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆113Updated this week
• flexudy-pipe / sentence-doctor
  Many Natural Language Processing tasks rely on sentence boundary detection (SBD). Although amazing libraries like spacy provide state of …
  ☆62Updated 5 years ago
• snukky / wikiedits
  Automatic extraction of edited sentences from text edition histories.
  ☆83Updated 3 years ago
• ghaddarAbs / WiNER
  ☆32Updated 4 years ago
• indix / whatthelang
  Lightning Fast Language Prediction 🚀
  ☆167Updated 3 months ago
• jwieting / para-nmt-50m
  Pre-trained models and code and data to train and use models from "Pushing the Limits of Paraphrastic Sentence Embeddings with Millions o…
  ☆103Updated 2 years ago
• hainan-xv / zipporah
  ☆42Updated 7 years ago
• thomasthiebaud / spacy-fastlang
  Language detection using Spacy and Fasttext
  ☆57Updated 2 years ago
• oscar-project / ungoliant
  The pipeline for the OSCAR corpus
  ☆174Updated last month
• MartinoMensio / spacy-sentence-bert
  Sentence transformers models for SpaCy
  ☆109Updated 2 years ago
• michiyasunaga / LM-Critic
  [EMNLP 2021] LM-Critic: Language Models for Unsupervised Grammatical Error Correction
  ☆120Updated 4 years ago