pytorch-tpu / transformersLinks
π€ Transformers: State-of-the-art Natural Language Processing for TensorFlow 2.0 and PyTorch.
β17Updated 2 months ago
Alternatives and similar repositories for transformers
Users that are interested in transformers are comparing it to the libraries listed below
Sorting:
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.β93Updated 2 years ago
- A Framework aims to wisely initialize unseen subword embeddings in PLMs for efficient large-scale continued pretrainingβ16Updated last year
- β98Updated 2 years ago
- Calculating Expected Time for training LLM.β38Updated 2 years ago
- Tutorial to pretrain & fine-tune a π€ Flax T5 model on a TPUv3-8 with GCPβ58Updated 2 years ago
- Pytorch Implementation of EncT5: Fine-tuning T5 Encoder for Non-autoregressive Tasksβ63Updated 3 years ago
- DQ-BART: Efficient Sequence-to-Sequence Model via Joint Distillation and Quantization (ACL 2022)β50Updated last year
- The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".β69Updated last year
- β72Updated 2 years ago
- PyTorch reimplementation of REALM and ORQAβ22Updated 3 years ago
- Pre-training BART in Flax on The Pile datasetβ21Updated 3 years ago
- Evaluation pipeline for the BabyLM Challenge 2023.β75Updated last year
- Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.β81Updated 8 months ago
- Train π€transformers with DeepSpeed: ZeRO-2, ZeRO-3β23Updated 4 years ago
- β97Updated 2 years ago
- Official Code for M-Rα΄α΄‘α΄Κα΄ Bα΄Ι΄α΄Κ: Evaluating Reward Models in Multilingual Settings (ACL 2025 Main)β28Updated 2 weeks ago
- β78Updated last year
- [TMLR'23] Contrastive Search Is What You Need For Neural Text Generationβ119Updated 2 years ago
- Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learningβ30Updated 2 years ago
- Dense hybrid representations for text retrievalβ62Updated 2 years ago
- data related codebase for polyglot projectβ19Updated 2 years ago
- The official implemetation of "Evidentiality-guided Generation for Knowledge-Intensive NLP Tasks" (NAACL 2022).β43Updated 2 years ago
- BLOOM+1: Adapting BLOOM model to support a new unseen languageβ72Updated last year
- β10Updated 2 years ago
- PyTorch reimplementation of the paper "SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarization"β16Updated 3 years ago
- A fast implementation of T5/UL2 in PyTorch using Flash Attentionβ105Updated 2 months ago
- Megatron LM 11B on Huggingface Transformersβ27Updated 3 years ago
- β72Updated last year
- DEMix Layers for Modular Language Modelingβ53Updated 3 years ago
- Tools for managing datasets for governance and training.β85Updated last week