NVIDIA / Diversity-SamplingLinks
GPU-accelerated algorithm for subsampling datasets while preserving diversity
☆24Updated last year
Alternatives and similar repositories for Diversity-Sampling
Users that are interested in Diversity-Sampling are comparing it to the libraries listed below
Sorting:
- Official implementation of "GPT or BERT: why not both?"☆59Updated last month
- A package for fine tuning of pretrained NLP transformers using Semi Supervised Learning☆14Updated 3 years ago
- A fast implementation of T5/UL2 in PyTorch using Flash Attention☆107Updated 6 months ago
- Minimal implementation of multiple PEFT methods for LLaMA fine-tuning☆13Updated 2 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆95Updated 2 years ago
- Embedding Recycling for Language models☆39Updated 2 years ago
- Hierarchical Attention Transformers (HAT)☆58Updated last year
- Code for Zero-Shot Tokenizer Transfer☆137Updated 8 months ago
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆27Updated last year
- A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.☆46Updated 2 months ago
- ☆75Updated last year
- State-of-the-art paired encoder and decoder models (17M-1B params)☆45Updated last month
- [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"☆34Updated 3 months ago
- ☆21Updated 4 years ago
- Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)☆63Updated 3 years ago
- some common Huggingface transformers in maximal update parametrization (µP)☆82Updated 3 years ago
- ☆54Updated 2 years ago
- Randomized Positional Encodings Boost Length Generalization of Transformers☆82Updated last year
- Official code release for "SuperBPE: Space Travel for Language Models"☆67Updated 2 months ago
- My explorations into editing the knowledge and memories of an attention network☆35Updated 2 years ago
- LTG-Bert☆33Updated last year
- Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and visi…☆29Updated 7 months ago
- Fast, Modern, and Low Precision PyTorch Optimizers☆109Updated 2 weeks ago
- No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models (ICLR 2022)☆29Updated 3 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated 2 years ago
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆59Updated last year
- ☆28Updated last year
- [ACL 2023] Gradient Ascent Post-training Enhances Language Model Generalization☆29Updated last year
- This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.1…☆134Updated 2 years ago
- Efficient Transformers with Dynamic Token Pooling☆63Updated 2 years ago