huggingface / spm_precompiledLinks
Highly specialized crate to parse and use `google/sentencepiece` 's precompiled_charsmap in `tokenizers`
☆19Updated this week
Alternatives and similar repositories for spm_precompiled
Users that are interested in spm_precompiled are comparing it to the libraries listed below
Sorting:
- Supporting example for "A Rust SentencePiece implementation"☆20Updated 5 years ago
- ☆13Updated 5 years ago
- ✨ Web interface for NeuralCoref coreference resolution☆34Updated 2 years ago
- LM Pretraining with PyTorch/TPU☆137Updated 6 years ago
- A generic library for crafting adversarial NLP examples - WIP☆41Updated 7 years ago
- Evaluating Machines by their Real-World Language Use☆33Updated 2 years ago
- Viewer for the 🤗 datasets library.☆86Updated 4 years ago
- ☆87Updated 3 years ago
- This repository contains the code for running the character-level Sandwich Transformers from our ACL 2020 paper on Improving Transformer …☆57Updated 5 years ago
- ☆65Updated 5 years ago
- Reference implementation of the paper "Word Embeddings for Entity-annotated Texts"☆18Updated 6 years ago
- Standalone pre-training recipe with JAX+Flax☆34Updated 2 years ago
- Official details for: [1803.08493] Context is Everything: Finding Meaning Statistically in Semantic Spaces☆39Updated 6 years ago
- numeric fused-head identification and resolution☆33Updated 6 years ago
- Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer☆39Updated 5 years ago
- ☆30Updated 4 years ago
- Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.☆147Updated 4 years ago
- An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.☆86Updated 4 years ago
- Language Model Fine-tuning for Moby Dick☆42Updated 6 years ago
- Assessing syntactic abilities of BERT☆40Updated 6 years ago
- This repository contains code to replicate the no-longer publicly available Toronto BookCorpus dataset☆49Updated 3 years ago
- ☆12Updated 3 years ago
- A web interface to understand language-specific BERT-models☆18Updated last year
- Code for the paper "Latent Relation Language Models" at AAAI-20.☆41Updated 3 months ago
- Implementation of Marge, Pre-training via Paraphrasing, in Pytorch☆76Updated 4 years ago
- This repo contains code to reproduce some of the results presented in the paper "SentenceMIM: A Latent Variable Language Model"☆28Updated 3 years ago
- Minimal code to train ELMo models in recent versions of TensorFlow☆14Updated 2 years ago
- Converter from UD-trees to BART representation☆36Updated last year
- Given a pair of sentences (premise, hypothesis), the decomposed graph entailment model (DGEM) predicts whether the premise can be used to…☆52Updated 4 years ago
- ☆11Updated 7 years ago