google-research / byt5
β489Updated 11 months ago
Alternatives and similar repositories for byt5:
Users that are interested in byt5 are comparing it to the libraries listed below
- NL-Augmenter π¦ β π A Collaborative Repository of Natural Language Transformationsβ779Updated 7 months ago
- Repository containing code for "How to Train BERT with an Academic Budget" paperβ310Updated last year
- FastFormers - highly efficient transformer models for NLUβ703Updated last year
- This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, anβ¦β555Updated 3 years ago
- Officially supported AllenNLP modelsβ534Updated 2 years ago
- Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)β325Updated last year
- XTREME is a benchmark for the evaluation of the cross-lingual generalization ability of pre-trained multilingual models that covers 40 tyβ¦β636Updated 2 years ago
- An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/pβ¦β429Updated 2 years ago
- Autoregressive Entity Retrievalβ775Updated last year
- β‘ boost inference speed of T5 models by 5x & reduce the model size by 3x.β571Updated last year
- Repository for the paper "Optimal Subarchitecture Extraction for BERT"β471Updated 2 years ago
- [ACL 2021] Learning Dense Representations of Phrases at Scale; EMNLP'2021: Phrase Retrieval Learns Passage Retrieval, Too https://arxiv.oβ¦β604Updated 2 years ago
- Fast BPEβ659Updated 6 months ago
- Library for Knowledge Intensive Language Tasksβ920Updated 2 years ago
- SentAugment is a data augmentation technique for NLP that retrieves similar sentences from a large bank of sentences. It can be used in cβ¦β362Updated 2 years ago
- BLEURT is a metric for Natural Language Generation based on transfer learning.β711Updated last year
- Python library & examples for Masked Language Model Scoring (ACL 2020)β339Updated 2 years ago
- β1,259Updated 2 years ago
- Parallelformers: An Efficient Model Parallelization Toolkit for Deploymentβ781Updated last year
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scaleβ154Updated last year
- β460Updated 3 years ago
- Tools to download and cleanup Common Crawl dataβ980Updated last year
- A Visual Analysis Tool to Explore Learned Representations in Transformers Modelsβ588Updated 11 months ago
- TyDi QA contains 200k human-annotated question-answer pairs in 11 Typologically Diverse languages, written without seeing the answer and β¦β299Updated 4 years ago
- This repository contains the code for "Generating Datasets with Pretrained Language Models".β187Updated 3 years ago
- Adversarial Natural Language Inference Benchmarkβ392Updated 2 years ago
- The corresponding code from our paper "DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations". Do not hesitate to oβ¦β380Updated last year
- Code associated with the Don't Stop Pretraining ACL 2020 paperβ529Updated 3 years ago
- Main repository for "CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters"β198Updated last year
- Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractiveβ¦β428Updated last year