Alternatives and similar repositories for Opensubtitles_dataset:

Users that are interested in Opensubtitles_dataset are comparing it to the libraries listed below

• neulab / newlang-tech
  A guide to building language technology in new languages.
  ☆58Updated 2 years ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated 3 months ago
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆49Updated this week
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆76Updated 4 months ago
• bitextor / bifixer
  Tool to fix bitexts and tag near-duplicates for removal
  ☆29Updated 5 months ago
• EleutherAI / openwebtext2
  ☆86Updated 2 years ago
• attilanagy234 / neural-punctuator
  Complimentary code for our paper Automatic punctuation restoration with BERT models
  ☆48Updated last year
• Felflare / rpunct
  📝An easy-to-use package to restore punctuation of the text.
  ☆111Updated last year
• google-research-datasets / Disfl-QA
  A Benchmark Dataset for Understanding Disfluencies in Question Answering
  ☆62Updated 3 years ago
• timoschick / dino
  This repository contains the code for "Generating Datasets with Pretrained Language Models".
  ☆187Updated 3 years ago
• bigscience-workshop / data_tooling
  Tools for managing datasets for governance and training.
  ☆81Updated 3 weeks ago
• bltlab / mot
  Multilingual Open Text
  ☆25Updated 2 months ago
• oscar-project / goclassy
  An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.
  ☆86Updated 3 years ago
• gsarti / t5-flax-gcp
  Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP
  ☆58Updated 2 years ago
• IamAdiSri / hf-trim
  Reduce the size of pretrained Hugging Face models via vocabulary trimming.
  ☆43Updated 2 years ago
• xinjli / phonepiece
  phone inventory library
  ☆16Updated last year
• google-research-datasets / TF-IDF-IIF-top100-wordlists
  These are lists for a variety of languages containing words that are distinctive to each language.
  ☆35Updated 2 years ago
• konstantinjdobler / focus
  [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"
  ☆29Updated 3 months ago
• bitextor / bicleaner-ai
  Bicleaner fork that uses neural networks
  ☆39Updated 5 months ago
• KennethEnevoldsen / augmenty
  Augmenty is an augmentation library based on spaCy for augmenting texts.
  ☆151Updated 7 months ago
• stefan-it / xlm-v-experiments
  Experiments for XLM-V Transformers Integeration
  ☆13Updated last year
• alirezamshi / small100
  Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…
  ☆24Updated last year
• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆88Updated 2 years ago
• laurieburchell / open-lid-dataset
  Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)
  ☆69Updated 8 months ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated last year
• facebookresearch / asset
  A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations
  ☆54Updated 2 years ago
• facebookresearch / stopes
  A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…
  ☆265Updated this week
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆104Updated this week
• deep-spin / tower-eval
  ☆27Updated this week
• hplt-project / OpusTrainer
  Curriculum training
  ☆16Updated this week