Alternatives and similar repositories for fastlangid

Users that are interested in fastlangid are comparing it to the libraries listed below

• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 5 years ago
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆33Updated last year
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆30Updated 4 months ago
• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆89Updated 2 years ago
• LightTag / sequence-labeling-with-transformers
  Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models
  ☆65Updated 2 years ago
• snukky / wikiedits
  Automatic extraction of edited sentences from text edition histories.
  ☆83Updated 3 years ago
• google-research-datasets / TF-IDF-IIF-top100-wordlists
  These are lists for a variety of languages containing words that are distinctive to each language.
  ☆38Updated 3 years ago
• sophiaalthammer / parm
  This repository contains the code for the paper 'PARM: Paragraph Aggregation Retrieval Model for Dense Document-to-Document Retrieval' pu…
  ☆40Updated 3 years ago
• AranKomat / adapinp
  Unofficial implementation of Adaptive Input in PyTorch
  ☆12Updated 6 years ago
• codogogo / towerparse
  Tower Parse: Low-Resource Dependency Parsing via Hierarchical Source Selection
  ☆15Updated 3 years ago
• ghaddarAbs / WiNER
  ☆33Updated 3 years ago
• octanove / grammartagger
  GrammarTagger — A Neural Multilingual Grammar Profiler for Language Learning
  ☆27Updated 4 years ago
• transducens / linguacrawl
  Crawling engine that crawls a set of top-level domains looking for documents in a list of languages
  ☆11Updated last year
• AU-DIS / LSTM_langid
  Source code for the Apple reproduction
  ☆32Updated 4 years ago
• mingruimingrui / ICU-tokenizer
  ICU based universal language tokenizer
  ☆32Updated 3 years ago
• webis-de / summary-explorer
  Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.
  ☆44Updated last year
• aboSamoor / pycld2
  ☆171Updated 3 months ago
• zaemyung / sentsplit
  A flexible sentence segmentation library using CRF model and regex rules
  ☆29Updated last year
• tigerchen52 / GLADIS
  GLADIS: A General and Large Acronym Disambiguation Benchmark (EACL 23)
  ☆16Updated last year
• amazon-science / contrastive-controlled-mt
  Code and data for the IWSLT 2022 shared task on Formality Control for SLT
  ☆21Updated 2 years ago
• shyyhs / CourseraParallelCorpusMining
  Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation
  ☆14Updated 10 months ago
• blester125 / iobes
  Tool for parsing and converting various span encoding schemes.
  ☆23Updated last year
• intfloat / uts
  python package for unsupervised text segmentation.
  ☆14Updated 8 years ago
• ChenghaoMou / embeddings
  zero-vocab or low-vocab embeddings
  ☆18Updated 2 years ago
• nttcslab-nlp / spanalign
  SpanAlign: Sentence Alignment Method based on Cross-Language Span Prediction and ILP
  ☆14Updated 4 years ago
• facebookresearch / mlqe
  We release a dataset based on Wikipedia sentences and the corresponding translations in 6 different languages along with the scores (scal…
  ☆81Updated 3 years ago
• AppraiseDev / OCELoT
  Project OCELoT: an Open, Collaborative Evaluation Leaderboard of Translations
  ☆20Updated this week
• spyysalo / wiki-bert-pipeline
  Generate BERT vocabularies and pretraining examples from Wikipedias
  ☆17Updated 5 years ago
• nttcslab-nlp / word_align
  A Supervised Word Alignment Method based on Cross-Language Span Prediction using Multilingual BERT
  ☆26Updated 4 years ago
• jgung / srleval
  CoNLL 2005 SRL (Semantic Role Labeling) evaluation script, implemented in Python
  ☆8Updated 6 years ago