explosion / curated-transformers
π€ A PyTorch library of curated Transformer models and their composable components
β885Updated last year
Alternatives and similar repositories for curated-transformers:
Users that are interested in curated-transformers are comparing it to the libraries listed below
- Creative interactive views of any dataset.β838Updated 4 months ago
- Fast & Simple repository for pre-training and fine-tuning T5-style modelsβ1,003Updated 8 months ago
- Fine-tune mistral-7B on 3090s, a100s, h100sβ711Updated last year
- just a bunch of useful embeddings for scikit-learn pipelinesβ497Updated last month
- Organize your experiments into discrete steps that can be cached and reused throughout the lifetime of your research project.β554Updated 11 months ago
- Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascriptβ576Updated 10 months ago
- Neural Searchβ355Updated last month
- Cramming the training of a (BERT-type) language model into limited compute.β1,331Updated 10 months ago
- The repository for the code of the UltraFastBERT paperβ517Updated last year
- Convolutions for Sequence Modelingβ878Updated 10 months ago
- Neural Searchβ329Updated 11 months ago
- Blazing fast framework for fine-tuning similarity learning modelsβ657Updated 3 weeks ago
- Language Modeling with the H3 State Space Modelβ520Updated last year
- Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wiβ¦β345Updated 9 months ago
- An open collection of implementation tips, tricks and resources for training large language modelsβ472Updated 2 years ago
- Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"β1,060Updated last year
- Salesforce open-source LLMs with 8k sequence length.β717Updated 3 months ago
- String-to-String Algorithms for Natural Language Processingβ545Updated 9 months ago
- An interactive exploration of Transformer programming.β262Updated last year
- What would you do with 1000 H100s...β1,043Updated last year
- A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many differentβ¦β287Updated 4 months ago
- git extension for {collaborative, communal, continual} model developmentβ211Updated 5 months ago
- Generate textbook-quality synthetic LLM pretraining dataβ498Updated last year
- A Simple Bulk Labelling Toolβ576Updated 4 months ago
- Efficient few-shot learning with Sentence Transformersβ2,477Updated 3 weeks ago
- Extend existing LLMs way beyond the original training length with constant memory usage, without retrainingβ697Updated last year
- Puzzles for exploring transformersβ344Updated 2 years ago
- Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.β381Updated 11 months ago
- A tiny library for coding with large language models.β1,230Updated 9 months ago
- Finetuning Large Language Models on One Consumer GPU in 2 Bitsβ722Updated 11 months ago