Alternatives and similar repositories for fastlangid

Users that are interested in fastlangid are comparing it to the libraries listed below

• oscar-project / goclassy
  An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.
  ☆86Updated 4 years ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆34Updated 2 months ago
• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆89Updated 3 years ago
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆33Updated last year
• bjascob / pyInflect
  A python module for word inflections designed for use with spaCy.
  ☆93Updated 5 years ago
• aboSamoor / pycld2
  ☆176Updated 8 months ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated last month
• nttcslab-nlp / spanalign
  SpanAlign: Sentence Alignment Method based on Cross-Language Span Prediction and ILP
  ☆14Updated 4 years ago
• GorkaUrbizu / Coreference-Corpora-Resources
  List of corpora annotated for coreference for different languages
  ☆17Updated last year
• bsolomon1124 / pycld3
  Python3 bindings for the Compact Language Detector v3 (CLD3)
  ☆155Updated 2 years ago
• shyyhs / CourseraParallelCorpusMining
  Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation
  ☆15Updated last year
• ChenghaoMou / embeddings
  zero-vocab or low-vocab embeddings
  ☆18Updated 3 years ago
• GT4SD / zero-shot-bert-adapters
  Implementation of Z-BERT-A: a zero-shot pipeline for unknown intent detection.
  ☆44Updated 2 years ago
• MartinoMensio / spacy-sentence-bert
  Sentence transformers models for SpaCy
  ☆109Updated 2 years ago
• AU-DIS / LSTM_langid
  Source code for the Apple reproduction
  ☆32Updated 4 years ago
• indix / whatthelang
  Lightning Fast Language Prediction 🚀
  ☆167Updated 3 months ago
• snukky / wikiedits
  Automatic extraction of edited sentences from text edition histories.
  ☆83Updated 3 years ago
• mediacloud / sentence-splitter
  Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.
  ☆255Updated 3 years ago
• LightTag / sequence-labeling-with-transformers
  Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models
  ☆64Updated 2 years ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 5 years ago
• lunayach / visNER
  In the wild extraction of entities that are found using Flair and displayed using a very elegant front-end.
  ☆71Updated 2 years ago
• laurieburchell / open-lid-dataset
  Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)
  ☆74Updated 7 months ago
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆112Updated 2 weeks ago
• kpu / preprocess
  Corpus preprocessing
  ☆99Updated last year
• braunefe / Gargantua
  ☆12Updated 9 years ago
• mhagiwara / xfspell
  xfspell — the Transformer Spell Checker
  ☆190Updated 5 years ago
• flexudy-pipe / sentence-doctor
  Many Natural Language Processing tasks rely on sentence boundary detection (SBD). Although amazing libraries like spacy provide state of …
  ☆62Updated 5 years ago
• wiragotama / TIARA-annotationTool
  An Interactive Tool for Annotating Discourse Structure and Text Improvement
  ☆16Updated 4 years ago
• thomasthiebaud / spacy-fastlang
  Language detection using Spacy and Fasttext
  ☆57Updated last year
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆86Updated last year