explosion / curated-transformers
🤖 A PyTorch library of curated Transformer models and their composable components
☆873Updated 9 months ago
Alternatives and similar repositories for curated-transformers:
Users that are interested in curated-transformers are comparing it to the libraries listed below
- Fast & Simple repository for pre-training and fine-tuning T5-style models☆986Updated 4 months ago
- Creative interactive views of any dataset.☆831Updated 3 weeks ago
- Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript☆562Updated 6 months ago
- Fine-tune mistral-7B on 3090s, a100s, h100s☆704Updated last year
- The repository for the code of the UltraFastBERT paper☆513Updated 9 months ago
- What would you do with 1000 H100s...☆948Updated last year
- Organize your experiments into discrete steps that can be cached and reused throughout the lifetime of your research project.☆538Updated 7 months ago
- Cramming the training of a (BERT-type) language model into limited compute.☆1,307Updated 7 months ago
- Neural Search☆349Updated 7 months ago
- Extend existing LLMs way beyond the original training length with constant memory usage, without retraining☆684Updated 9 months ago
- An open collection of implementation tips, tricks and resources for training large language models☆466Updated last year
- String-to-String Algorithms for Natural Language Processing☆539Updated 5 months ago
- Language Modeling with the H3 State Space Model☆516Updated last year
- Inference code for Persimmon-8B☆416Updated last year
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆253Updated last year
- [NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333☆1,075Updated last year
- ☆413Updated last year
- just a bunch of useful embeddings for scikit-learn pipelines☆474Updated 3 weeks ago
- The Fastest State-of-the-Art Static Embeddings in the World☆579Updated this week
- Puzzles for exploring transformers☆331Updated last year
- batched loras☆336Updated last year
- Convolutions for Sequence Modeling☆875Updated 7 months ago
- Tune any FALCON in 4-bit☆466Updated last year
- An interactive exploration of Transformer programming.☆255Updated last year
- Prompt programming with FMs.☆440Updated 5 months ago
- Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.☆378Updated 7 months ago
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines☆196Updated 8 months ago