Alternatives and similar repositories for fast-mosestokenizer:

Users that are interested in fast-mosestokenizer are comparing it to the libraries listed below

• marian-nmt / sotastream
  A library for data streaming and augmentation
  ☆20Updated 11 months ago
• jniehues-kit / SLT.KIT
  Spoken Language Translation System
  ☆14Updated 5 years ago
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆33Updated 8 months ago
• noe / fairseq-tensorboard
  Small utility to monitor fairseq training in tensorboard
  ☆21Updated 5 years ago
• nyu-mll / pretraining-learning-curves
  The repository for the paper "When Do You Need Billions of Words of Pretraining Data?"
  ☆21Updated 4 years ago
• UriSha / EmbeddinglessNMT
  The implementation of "Neural Machine Translation without Embeddings", NAACL 2021
  ☆33Updated 3 years ago
• bltlab / mot
  Multilingual Open Text
  ☆25Updated 4 months ago
• cindyxinyiwang / SDE
  Source code for the paper "Multilingual Neural Machine Translation with Soft Decoupled Encoding"
  ☆29Updated 3 years ago
• seraphlabs-ca / SentenceMIM-demo
  This repo contains code to reproduce some of the results presented in the paper "SentenceMIM: A Latent Variable Language Model"
  ☆28Updated 2 years ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 4 years ago
• cambridgeltl / parameter-factorization
  Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer
  ☆39Updated 4 years ago
• allenai / sledgehammer
  ☆47Updated 4 years ago
• harvardnlp / hmm-lm
  ☆42Updated 3 years ago
• Roxot / mbr-nmt
  Sampling-Based Minimum Bayes-Risk Decoding for Neural Machine Translation
  ☆16Updated 2 years ago
• StonyBrookNLP / HAQAE
  Hierarchical And Quantized AutoEncoders
  ☆13Updated 4 years ago
• matthewfl / openfst-wrapper
  ☆28Updated 4 years ago
• sigmorphon / 2020
  SIGMORPHON 2020 Shared Task: Grapheme-to-Phoneme, Unsupervised Induction of Morphology, and Typologically Diverse Morphological Inflectio…
  ☆36Updated 4 years ago
• MiuLab / Lattice-Transformer-SLU
  Source code for ASRU 2019 paper "Adapting Pretrained Transformer to Lattices for Spoken Language Understanding"
  ☆11Updated 4 years ago
• jsenellart / papers
  This repo is containing notes and implementations for cherry-picked publications of my particular interest
  ☆12Updated 4 years ago
• bdusell / grefenstette-stack-lstm
  DyNet implementation of stack LSTM experiments by Grefenstette et al.
  ☆21Updated 7 years ago
• tnq177 / witwicky
  Witwicky: An implementation of Transformer in PyTorch.
  ☆22Updated 4 years ago
• tombosc / cpae
  Code for EMNLP 2018 paper "Auto-Encoding Dictionary Definitions into Consistent Word Embeddings"
  ☆36Updated 6 years ago
• mayhewsw / multilingual-data-stats
  Statistics on multilingual datasets
  ☆17Updated 2 years ago
• neubig / rapid-adaptation
  Reproduction instructions for "Rapid Adaptation of Neural Machine Translation to New Languages"
  ☆40Updated 6 years ago
• zbloss / reformer_lm
  a Pytorch implementation of the Reformer Network (https://openreview.net/pdf?id=rkgNKkHtvB)
  ☆53Updated 2 years ago
• ofirpress / sandwich_transformer
  This repository contains the code for running the character-level Sandwich Transformers from our ACL 2020 paper on Improving Transformer …
  ☆55Updated 4 years ago
• aaronmueller / clams
  Syntactic evaluation sets, attribute-varying grammars, and code for replicating the CLAMS paper. ACL 2020.
  ☆15Updated 3 months ago
• yanaiela / num_fh
  numeric fused-head identification and resolution
  ☆33Updated 5 years ago
• neulab / lrlm
  Code for the paper "Latent Relation Language Models" at AAAI-20.
  ☆41Updated 4 years ago
• snakers4 / cft-contest-2018
  Repository with illustrations for cft-contest-2018
  ☆12Updated 6 years ago