mingruimingrui / fast-mosestokenizer

Related projects: ⓘ

• marian-nmt / sotastream
  A library for data streaming and augmentation
  ☆20Updated 6 months ago
• cambridgeltl / parameter-factorization
  Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer
  ☆39Updated 3 years ago
• alexandres / awd-lstm-lm-ThinkNet
  ☆36Updated this week
• mayhewsw / multilingual-data-stats
  Statistics on multilingual datasets
  ☆17Updated 2 years ago
• seraphlabs-ca / SentenceMIM-demo
  This repo contains code to reproduce some of the results presented in the paper "SentenceMIM: A Latent Variable Language Model"
  ☆28Updated 2 years ago
• cindyxinyiwang / SDE
  Source code for the paper "Multilingual Neural Machine Translation with Soft Decoupled Encoding"
  ☆29Updated 3 years ago
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆31Updated 3 months ago
• UriSha / EmbeddinglessNMT
  The implementation of "Neural Machine Translation without Embeddings", NAACL 2021
  ☆33Updated 3 years ago
• jniehues-kit / SLT.KIT
  Spoken Language Translation System
  ☆14Updated 5 years ago
• matthewfl / openfst-wrapper
  ☆27Updated 3 years ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆34Updated 4 years ago
• McGill-NLP / latent-translation
  Code for the paper "Modelling Latent Translations for Cross-Lingual Transfer"
  ☆17Updated 2 years ago
• neubig / rapid-adaptation
  Reproduction instructions for "Rapid Adaptation of Neural Machine Translation to New Languages"
  ☆39Updated 6 years ago
• jungokasai / deep-shallow
  ☆42Updated 4 years ago
• UKPLab / linspector
  ☆23Updated 4 years ago
• nyu-mll / pretraining-learning-curves
  The repository for the paper "When Do You Need Billions of Words of Pretraining Data?"
  ☆20Updated 3 years ago
• nikitakit / sabertooth
  Standalone pre-training recipe with JAX+Flax
  ☆31Updated last year
• valentinhofmann / flota
  ☆15Updated last year
• tnq177 / witwicky
  Witwicky: An implementation of Transformer in PyTorch.
  ☆22Updated 4 years ago
• MultiPath / Efficient-Neural-Machine-Translation
  PhD thesis (updating) of Jiatao Gu from HKU
  ☆19Updated 6 years ago
• harvardnlp / hmm-lm
  ☆42Updated 3 years ago
• allenai / sledgehammer
  ☆47Updated 4 years ago
• ofirpress / sandwich_transformer
  This repository contains the code for running the character-level Sandwich Transformers from our ACL 2020 paper on Improving Transformer …
  ☆55Updated 3 years ago
• neulab / lrlm
  Code for the paper "Latent Relation Language Models" at AAAI-20.
  ☆41Updated 4 years ago
• yanaiela / num_fh
  numeric fused-head identification and resolution
  ☆33Updated 4 years ago
• anoopkunchukuttan / geomm
  Geometry-aware Multilingual Embeddings
  ☆25Updated last year
• Roxot / mbr-nmt
  Sampling-Based Minimum Bayes-Risk Decoding for Neural Machine Translation
  ☆14Updated last year
• bzhangGo / lrn
  Source code for "A Lightweight Recurrent Network for Sequence Modeling"
  ☆26Updated last year
• cgraywang / transformer-on-diet
  Code repo for "Transformer on a Diet" paper
  ☆31Updated 4 years ago
• ITUnlp / UniParse
  UniParse: A universal graph-based parsing toolkit
  ☆10Updated 4 years ago