Alternatives and similar repositories for Diversity-Sampling:

Users that are interested in Diversity-Sampling are comparing it to the libraries listed below

• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆36Updated 2 years ago
• nreimers / se-pytorch-xla
  ☆21Updated 3 years ago
• cliang1453 / SAGE
  No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models (ICLR 2022)
  ☆30Updated 3 years ago
• warner-benjamin / optimi
  Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers
  ☆82Updated 7 months ago
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆48Updated last year
• microsoft / AdaMix
  This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.1…
  ☆127Updated last year
• smly / vscode-fast-kaggle
  VS Code Extension for Kaggle
  ☆17Updated 2 months ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆79Updated 2 years ago
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆60Updated 2 years ago
• mgmalek / efficient_cross_entropy
  ☆91Updated 8 months ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• jiaweizzhao / ZerO-initialization
  ☆73Updated 2 years ago
• tascj / kaggle-feedback-prize-2021
  Solution of Kaggle competition: Feedback Prize - Evaluating Student Writing
  ☆17Updated 2 years ago
• psinger / kaggle-curriculum-solution
  ☆17Updated last year
• ltgoslo / gpt-bert
  Official implementation of "GPT or BERT: why not both?"
  ☆47Updated 3 weeks ago
• PiotrNawrot / dynamic-pooling
  Efficient Transformers with Dynamic Token Pooling
  ☆58Updated last year
• google-deepmind / randomized_positional_encodings
  Randomized Positional Encodings Boost Length Generalization of Transformers
  ☆79Updated 11 months ago
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆81Updated 3 weeks ago
• bloodwass / mixout
  Implementation of Mixout with PyTorch
  ☆74Updated 2 years ago
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 2 years ago
• lucidrains / n-grammer-pytorch
  Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch
  ☆72Updated 2 years ago
• lucidrains / coco-lm-pytorch
  Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch
  ☆45Updated 3 years ago
• iliaschalkidis / flash-roberta
  Hugging Face RoBERTa with Flash Attention 2
  ☆21Updated last year
• lucidrains / axial-positional-embedding
  Axial Positional Embedding for Pytorch
  ☆70Updated last week
• yang-zhang / labse-pytorch
  Language-agnostic BERT Sentence Embedding (LaBSE) Pytorch Model
  ☆21Updated 4 years ago
• Ankush7890 / ssfinetuning
  A package for fine tuning of pretrained NLP transformers using Semi Supervised Learning
  ☆15Updated 3 years ago
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆34Updated 2 years ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆70Updated 3 months ago
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year