Alternatives and similar repositories for terashuf

Users that are interested in terashuf are comparing it to the libraries listed below

• soaxelbrooke / python-bpe
  Byte Pair Encoding for Python!
  ☆231Updated 3 years ago
• glample / fastBPE
  Fast BPE
  ☆675Updated last year
• microsoft / infinibatch
  Efficient, check-pointed data loading for deep learning with massive data sets.
  ☆209Updated 2 years ago
• microsoft / fastseq
  An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…
  ☆432Updated 3 years ago
• oaqa / FlexNeuART
  Flexible classic and NeurAl Retrieval Toolkit
  ☆220Updated 2 months ago
• yannvgn / laserembeddings
  LASER multilingual sentence embeddings as a pip package
  ☆224Updated 2 years ago
• kawine / usif
  Implementation of unsupervised smoothed inverse frequency (Best Paper, Repl4NLP @ ACL 2018)
  ☆78Updated 6 years ago
• mtreviso / linear-chain-crf
  Implementation of a linear-chain CRF in PyTorch
  ☆97Updated 4 years ago
• facebookresearch / unlikelihood_training
  Neural Text Generation with Unlikelihood Training
  ☆309Updated 4 years ago
• tca19 / near-lossless-binarization
  This repository contains source code to binarize any real-value word embeddings into binary vectors.
  ☆47Updated 4 years ago
• studio-ousia / bpr
  Binary Passage Retriever (BPR) - an efficient passage retriever for open-domain question answering
  ☆172Updated 4 years ago
• hamed-zamani / snrm
  Standalone Neural Ranking Model (SNRM)
  ☆76Updated 6 years ago
• microsoft / MPNet
  MPNet: Masked and Permuted Pre-training for Language Understanding https://arxiv.org/pdf/2004.09297.pdf
  ☆292Updated 4 years ago
• simonepri / lm-scorer
  📃Language Model based sentences scoring library
  ☆309Updated 3 years ago
• uds-lsv / bert-stable-fine-tuning
  On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
  ☆137Updated 2 years ago
• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆89Updated 2 years ago
• rdspring1 / PyTorch_GBW_LM
  PyTorch Language Model for 1-Billion Word (LM1B / GBW) Dataset
  ☆123Updated 6 years ago
• lena-voita / good-translation-wrong-in-context
  This is a repository with the data and code for the ACL 2019 paper "When a Good Translation is Wrong in Context: ..." and the EMNLP 2019 …
  ☆97Updated 5 years ago
• nyu-dl / bert-gen
  ☆324Updated 2 years ago
• urvashik / knnlm
  ☆323Updated 4 years ago
• lilt / alignment-scripts
  Scripts to preprocess training and test data and to run fast_align and giza
  ☆108Updated 3 years ago
• alexa / bort
  Repository for the paper "Optimal Subarchitecture Extraction for BERT"
  ☆472Updated 3 years ago
• google-research-datasets / wiki-split
  One million English sentences, each split into two sentences that together preserve the original meaning, extracted from Wikipedia edits.
  ☆122Updated 6 years ago
• BinWang28 / SBERT-WK-Sentence-Embedding
  IEEE/ACM TASLP 2020: SBERT-WK: A Sentence Embedding Method By Dissecting BERT-based Word Models
  ☆180Updated 4 years ago
• zomux / neuralcompressor
  Embedding Quantization (Compress Word Embeddings)
  ☆86Updated 6 years ago
• bojone / labse
  Language-agnostic BERT Sentence Embedding (LaBSE)
  ☆152Updated 5 years ago
• awasthiabhijeet / PIE
  Fast + Non-Autoregressive Grammatical Error Correction using BERT. Code and Pre-trained models for paper "Parallel Iterative Edit Models …
  ☆230Updated 2 years ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆136Updated 5 years ago
• nyu-dl / dl4ir-doc2query
  ☆162Updated 5 years ago
• luyug / COIL
  NAACL2021 - COIL Contextualized Lexical Retriever
  ☆154Updated 4 years ago