Alternatives and similar repositories for GlotScript

Users that are interested in GlotScript are comparing it to the libraries listed below

• cisnlp / GlotWeb
  🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.
  ☆17Updated 5 months ago
• UBC-NLP / afrolid
  AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.
  ☆35Updated this week
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆57Updated 4 months ago
• rewicks / ersatz
  ☆50Updated last year
• laurieburchell / open-lid-dataset
  Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)
  ☆74Updated 10 months ago
• google-research-datasets / TF-IDF-IIF-top100-wordlists
  These are lists for a variety of languages containing words that are distinctive to each language.
  ☆41Updated 3 years ago
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆115Updated this week
• sortiz / tmxt
  Transform TMX to text
  ☆28Updated 3 years ago
• robertostling / eflomal
  Efficient Low-Memory Aligner
  ☆146Updated last year
• ehsanasgari / 1000Langs
  Creating super-parallel corpora of more than 1500+ unique languages for NLP research
  ☆34Updated 3 years ago
• mhulden / pyfoma
  Python Finite-State Toolkit
  ☆60Updated last month
• hplt-project / OpusTrainer
  Curriculum training
  ☆22Updated 7 months ago
• thammegowda / mtdata
  A tool that locates, downloads, and extracts machine translation corpora
  ☆162Updated 4 months ago
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆160Updated last year
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆34Updated 5 months ago
• feralvam / easse
  Easier Automatic Sentence Simplification Evaluation
  ☆166Updated 2 years ago
• udapi / udapi-python
  Python framework for processing Universal Dependencies data
  ☆59Updated last week
• mainlp / germanic-lrl-corpora
  A survey of corpora for Germanic low-resource languages and dialects
  ☆26Updated last year
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆88Updated last year
• Helsinki-NLP / OpusTools
  ☆81Updated last week
• AppraiseDev / Appraise
  Appraise code used as part of WMT21 human evaluation campaign
  ☆30Updated last month
• nert-nlp / streusle
  STREUSLE: a corpus with comprehensive lexical semantic annotation (multiword expressions, supersenses)
  ☆69Updated 2 months ago
• hipe-eval / HIPE-scorer
  A python module for evaluating NERC and NEL system performances as defined in the HIPE shared tasks (formerly CLEF-HIPE-2020-scorer).
  ☆15Updated last year
• pyconll / pyconll
  A minimal, pure Python library to interface with CoNLL-U format files.
  ☆153Updated 2 months ago
• mariananeves / annotation-tools
  ☆64Updated 3 years ago
• mbanon / fastspell
  Targetted language identifier, based on FastText and Hunspell.
  ☆38Updated 5 months ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆107Updated last year
• thompsonb / vecalign
  Improved Sentence Alignment in Linear Time and Space
  ☆188Updated 2 years ago
• amir-zeldes / gum
  Repository for the Georgetown University Multilayer Corpus (GUM)
  ☆104Updated this week
• google-research / url-nlp
  ☆263Updated 6 months ago