Alternatives and similar repositories for terashuf

Users that are interested in terashuf are comparing it to the libraries listed below

• glample / fastBPE
  Fast BPE
  ☆678Updated last year
• soaxelbrooke / python-bpe
  Byte Pair Encoding for Python!
  ☆232Updated 3 years ago
• microsoft / infinibatch
  Efficient, check-pointed data loading for deep learning with massive data sets.
  ☆210Updated 2 years ago
• microsoft / fastseq
  An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…
  ☆433Updated 3 years ago
• facebookresearch / unlikelihood_training
  Neural Text Generation with Unlikelihood Training
  ☆310Updated 4 years ago
• mtreviso / linear-chain-crf
  Implementation of a linear-chain CRF in PyTorch
  ☆98Updated 4 years ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆136Updated 6 years ago
• oaqa / FlexNeuART
  Flexible classic and NeurAl Retrieval Toolkit
  ☆220Updated 5 months ago
• zomux / neuralcompressor
  Embedding Quantization (Compress Word Embeddings)
  ☆85Updated 6 years ago
• nyu-dl / bert-gen
  ☆324Updated 2 years ago
• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆89Updated 3 years ago
• simonepri / lm-scorer
  📃Language Model based sentences scoring library
  ☆308Updated 3 years ago
• yannvgn / laserembeddings
  LASER multilingual sentence embeddings as a pip package
  ☆225Updated 2 years ago
• tca19 / near-lossless-binarization
  This repository contains source code to binarize any real-value word embeddings into binary vectors.
  ☆48Updated 4 years ago
• awslabs / mlm-scoring
  Python library & examples for Masked Language Model Scoring (ACL 2020)
  ☆347Updated 2 years ago
• kawine / usif
  Implementation of unsupervised smoothed inverse frequency (Best Paper, Repl4NLP @ ACL 2018)
  ☆78Updated 6 years ago
• explosion / tokenizations
  Robust and Fast tokenizations alignment library for Rust and Python https://tamuhey.github.io/tokenizations/
  ☆193Updated 2 years ago
• studio-ousia / bpr
  Binary Passage Retriever (BPR) - an efficient passage retriever for open-domain question answering
  ☆174Updated 4 years ago
• microsoft / MPNet
  MPNet: Masked and Permuted Pre-training for Language Understanding https://arxiv.org/pdf/2004.09297.pdf
  ☆295Updated 4 years ago
• neulab / compare-mt
  A tool for holistic analysis of language generations systems
  ☆471Updated 2 months ago
• urvashik / knnlm
  ☆326Updated 4 years ago
• hamed-zamani / snrm
  Standalone Neural Ranking Model (SNRM)
  ☆76Updated 6 years ago
• kpu / preprocess
  Corpus preprocessing
  ☆99Updated last year
• microsoft / ANCE
  A novel embedding training algorithm leveraging ANN search and achieved SOTA retrieval on Trec DL 2019 and OpenQA benchmarks
  ☆379Updated 2 years ago
• awasthiabhijeet / PIE
  Fast + Non-Autoregressive Grammatical Error Correction using BERT. Code and Pre-trained models for paper "Parallel Iterative Edit Models …
  ☆231Updated 2 years ago
• lena-voita / good-translation-wrong-in-context
  This is a repository with the data and code for the ACL 2019 paper "When a Good Translation is Wrong in Context: ..." and the EMNLP 2019 …
  ☆98Updated 5 years ago
• thammegowda / mtdata
  A tool that locates, downloads, and extracts machine translation corpora
  ☆159Updated 2 months ago
• neulab / InterpretEval
  Interpretable Evaluation for (Almost) All NLP Tasks
  ☆195Updated 2 months ago
• allenai / allentune
  Hyperparameter Search for AllenNLP
  ☆140Updated 8 months ago
• uds-lsv / bert-stable-fine-tuning
  On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
  ☆137Updated 2 years ago