Alternatives and similar repositories for terashuf

Users that are interested in terashuf are comparing it to the libraries listed below

• soaxelbrooke / python-bpe
  Byte Pair Encoding for Python!
  ☆231Updated 3 years ago
• glample / fastBPE
  Fast BPE
  ☆677Updated last year
• microsoft / infinibatch
  Efficient, check-pointed data loading for deep learning with massive data sets.
  ☆209Updated 2 years ago
• yannvgn / laserembeddings
  LASER multilingual sentence embeddings as a pip package
  ☆224Updated 2 years ago
• kawine / usif
  Implementation of unsupervised smoothed inverse frequency (Best Paper, Repl4NLP @ ACL 2018)
  ☆78Updated 6 years ago
• mtreviso / linear-chain-crf
  Implementation of a linear-chain CRF in PyTorch
  ☆97Updated 4 years ago
• lena-voita / good-translation-wrong-in-context
  This is a repository with the data and code for the ACL 2019 paper "When a Good Translation is Wrong in Context: ..." and the EMNLP 2019 …
  ☆97Updated 5 years ago
• uds-lsv / bert-stable-fine-tuning
  On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
  ☆137Updated 2 years ago
• VProv / BPE-Dropout
  An official implementation of "BPE-Dropout: Simple and Effective Subword Regularization" algorithm.
  ☆52Updated 4 years ago
• microsoft / fastseq
  An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…
  ☆432Updated 3 years ago
• simonepri / lm-scorer
  📃Language Model based sentences scoring library
  ☆309Updated 3 years ago
• facebookresearch / unlikelihood_training
  Neural Text Generation with Unlikelihood Training
  ☆309Updated 4 years ago
• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆89Updated 2 years ago
• kpu / preprocess
  Corpus preprocessing
  ☆99Updated last year
• M4t1ss / SoftAlignments
  Neural macine translation soft alignment visualisations for web and command line
  ☆72Updated 4 years ago
• bojone / labse
  Language-agnostic BERT Sentence Embedding (LaBSE)
  ☆153Updated 5 years ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆136Updated 5 years ago
• zphang / bert_on_stilts
  Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs
  ☆106Updated 2 years ago
• tca19 / near-lossless-binarization
  This repository contains source code to binarize any real-value word embeddings into binary vectors.
  ☆47Updated 4 years ago
• snukky / wikiedits
  Automatic extraction of edited sentences from text edition histories.
  ☆83Updated 3 years ago
• studio-ousia / bpr
  Binary Passage Retriever (BPR) - an efficient passage retriever for open-domain question answering
  ☆172Updated 4 years ago
• oaqa / FlexNeuART
  Flexible classic and NeurAl Retrieval Toolkit
  ☆221Updated 3 months ago
• sgraaf / Replicate-Toronto-BookCorpus
  This repository contains code to replicate the no-longer publicly available Toronto BookCorpus dataset
  ☆49Updated 3 years ago
• EdinburghNLP / opus-100-corpus
  ☆94Updated last year
• microsoft / MPNet
  MPNet: Masked and Permuted Pre-training for Language Understanding https://arxiv.org/pdf/2004.09297.pdf
  ☆292Updated 4 years ago
• allenai / allentune
  Hyperparameter Search for AllenNLP
  ☆139Updated 7 months ago
• facebookresearch / mlqe
  We release a dataset based on Wikipedia sentences and the corresponding translations in 6 different languages along with the scores (scal…
  ☆81Updated 4 years ago
• explosion / tokenizations
  Robust and Fast tokenizations alignment library for Rust and Python https://tamuhey.github.io/tokenizations/
  ☆193Updated 2 years ago
• laiguokun / Funnel-Transformer
  ☆219Updated 5 years ago
• hamed-zamani / snrm
  Standalone Neural Ranking Model (SNRM)
  ☆76Updated 6 years ago