Alternatives and similar repositories for language-identification

Users that are interested in language-identification are comparing it to the libraries listed below

• dialogue-evaluation / GramEval2020
  ☆24Updated 4 years ago
• snakers4 / emoji-sentiment-dataset
  ☆15Updated 6 years ago
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆33Updated last year
• Geotrend-research / smaller-transformers
  Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.
  ☆105Updated 3 years ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆34Updated 4 months ago
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆86Updated last year
• asappresearch / sew
  ☆76Updated 4 years ago
• davidalami / ConveRT
  Dual Encoders for State-of-the-art Natural Language Processing.
  ☆60Updated 3 years ago
• snakers4 / cft-contest-2018
  Repository with illustrations for cft-contest-2018
  ☆12Updated 7 years ago
• anyks / alm
  Smart Language Model
  ☆47Updated 3 years ago
• karanmakhija867 / bert_punct
  Punctuation restoration in ASR text
  ☆33Updated 6 years ago
• anton-l / wav2vec-toolkit
  A collection of scripts to preprocess ASR datasets and finetune language-specific Wav2Vec2 XLSR models
  ☆30Updated 4 years ago
• vsiivola / variKN
  A toolkit for producing n-gram language models. The highlights are the implementation of Kneser-Ney growing and revised Kneser pruning me…
  ☆42Updated 4 months ago
• jacklxc / StandAloneSpellingCorrection
  Repository for Findings of EMNLP 2020 "Context-aware Stand-alone Neural Spelling Correction"
  ☆18Updated 5 years ago
• RussianNLP / RuBLiMP
  RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs
  ☆19Updated 10 months ago
• marian-nmt / sotastream
  A library for data streaming and augmentation
  ☆21Updated 8 months ago
• oscar-project / goclassy
  An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.
  ☆86Updated 4 years ago
• egorsmkv / asr-corpus-creator
  This app is intended to automatically create a corpus for ASR systems using pseudo-labeling.
  ☆27Updated last year
• MiuLab / Lattice-Transformer-SLU
  Source code for ASRU 2019 paper "Adapting Pretrained Transformer to Lattices for Spoken Language Understanding"
  ☆10Updated 5 years ago
• AU-DIS / LSTM_langid
  Source code for the Apple reproduction
  ☆32Updated 4 years ago
• helboukkouri / character-bert-pretraining
  Code for pre-training CharacterBERT models (as well as BERT models).
  ☆34Updated 4 years ago
• EgorLakomkin / KTSpeechCrawler
  Automatically constructing corpus for automatic speech recognition from YouTube videos
  ☆157Updated 5 years ago
• frozentoad9 / CMST
  Prabhupadavani: A Code-mixed Speech Translation Data for 25 languages
  ☆13Updated 3 years ago
• attilanagy234 / neural-punctuator
  Complimentary code for our paper Automatic punctuation restoration with BERT models
  ☆50Updated 2 years ago
• openlanguagedata / seed
  Seed Machine Translation Data
  ☆33Updated last year
• NLP-Core-Team / mmlu_ru
  MMLU eval for RU/EN
  ☆15Updated 2 years ago
• jqueguiner / wav2vec2-sprint
  docker for HF wav2vec2-sprint
  ☆13Updated 4 years ago
• shijie-wu / neural-transducer
  This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.
  ☆76Updated 2 years ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated 2 weeks ago
• Prem-kumar27 / Fast-KTSpeechCrawler
  Parallelized automatic corpus collection for ASR. Forked from https://github.com/EgorLakomkin/KTSpeechCrawler
  ☆24Updated 4 years ago