NVIDIA / Diversity-Sampling
GPU-accelerated algorithm for subsampling datasets while preserving diversity
☆19Updated last year
Alternatives and similar repositories for Diversity-Sampling:
Users that are interested in Diversity-Sampling are comparing it to the libraries listed below
- Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers☆88Updated 8 months ago
- Various transformers for FSDP research☆37Updated 2 years ago
- HomebrewNLP in JAX flavour for maintable TPU-Training☆49Updated last year
- ☆21Updated 3 years ago
- Randomized Positional Encodings Boost Length Generalization of Transformers☆80Updated last year
- My explorations into editing the knowledge and memories of an attention network☆34Updated 2 years ago
- some common Huggingface transformers in maximal update parametrization (µP)☆80Updated 3 years ago
- VS Code Extension for Kaggle☆17Updated 3 months ago
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆57Updated 10 months ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆93Updated 2 years ago
- Efficient Transformers with Dynamic Token Pooling☆60Updated last year
- Early solution for Google AI4Code competition☆76Updated 2 years ago
- A case study of efficient training of large language models using commodity hardware.☆69Updated 2 years ago
- Official implementation of "GPT or BERT: why not both?"☆50Updated 3 weeks ago
- Solution of Kaggle competition: Feedback Prize - Evaluating Student Writing☆17Updated 3 years ago
- RSNA 2022 - 3rd Place solution - Cervical Spine Fracture Detection☆13Updated 2 years ago
- supporting pytorch FSDP for optimizers☆80Updated 3 months ago
- ☆79Updated 11 months ago
- ☆20Updated last year
- Embedding Recycling for Language models☆38Updated last year
- Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch☆99Updated 2 years ago
- PyTorch library for Active Fine-Tuning☆62Updated last month
- ☆73Updated 11 months ago
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆26Updated 11 months ago
- A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.☆65Updated 8 months ago
- Hugging Face RoBERTa with Flash Attention 2☆22Updated last year
- A fast implementation of T5/UL2 in PyTorch using Flash Attention☆98Updated 2 weeks ago
- ☆73Updated 2 years ago
- Ensembling Hugging Face transformers made easy☆62Updated 2 years ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆71Updated 5 months ago