Alternatives and similar repositories for Opensubtitles_dataset:

Users that are interested in Opensubtitles_dataset are comparing it to the libraries listed below

• neulab / newlang-tech
  A guide to building language technology in new languages.
  ☆58Updated 3 years ago
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆51Updated 3 months ago
• EleutherAI / openwebtext2
  ☆90Updated 2 years ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated 6 months ago
• oscar-project / goclassy
  An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.
  ☆86Updated 4 years ago
• currentslab / fastlangid
  fastlangid, the only language identification package that support cantonese (zh-yue), simplified (zh-hans) and traditional chinese (zh-ha…
  ☆39Updated 2 years ago
• thammegowda / mtdata
  A tool that locates, downloads, and extracts machine translation corpora
  ☆154Updated 3 weeks ago
• Helsinki-NLP / OpusTools
  ☆72Updated 3 weeks ago
• oscar-project / ungoliant
  The pipeline for the OSCAR corpus
  ☆168Updated last year
• rewicks / ersatz
  ☆47Updated 9 months ago
• bitextor / bicleaner-ai
  Bicleaner fork that uses neural networks
  ☆40Updated 9 months ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆30Updated 2 months ago
• feralvam / easse
  Easier Automatic Sentence Simplification Evaluation
  ☆159Updated last year
• xinjli / phonepiece
  phone inventory library
  ☆16Updated last year
• deep-spin / tower-eval
  ☆29Updated 3 weeks ago
• laurieburchell / open-lid-dataset
  Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)
  ☆72Updated 3 weeks ago
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆80Updated 7 months ago
• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆88Updated 2 years ago
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆104Updated last month
• kbatsuren / MorphyNet
  MorphyNet: a Large Multilingual Database of Derivational and Inflectional Morphology (+morpheme segmentation)
  ☆44Updated 2 years ago
• shijie-wu / neural-transducer
  This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.
  ☆74Updated last year
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆157Updated 10 months ago
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆127Updated 4 months ago
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆83Updated 10 months ago
• SapienzaNLP / ewiser
  A Word Sense Disambiguation system integrating implicit and explicit external knowledge.
  ☆69Updated 3 years ago
• mariosasko / datasets_sql
  Execute arbitrary SQL queries on 🤗 Datasets
  ☆32Updated last year
• ltgoslo / ltg-bert
  LTG-Bert
  ☆32Updated last year
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆177Updated last year
• timoschick / dino
  This repository contains the code for "Generating Datasets with Pretrained Language Models".
  ☆188Updated 3 years ago
• bminixhofer / gerpt2
  German small and large versions of GPT2.
  ☆20Updated 2 years ago