Norod / TrainGPT2-127M-FromScratch
A trio of Google-Colab notebooks (ipynb) for training a GPT-2 (127M) model from scratch (useful for other / non-English languages) using gpt-2-simple
☆15Updated 4 years ago
Alternatives and similar repositories for TrainGPT2-127M-FromScratch:
Users that are interested in TrainGPT2-127M-FromScratch are comparing it to the libraries listed below
- ☆14Updated last year
- ☆27Updated last year
- Load any clip model with a standardized interface☆21Updated 9 months ago
- Experimental sampler to make LLMs more creative☆30Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 10 months ago
- Merge LLM that are split in to parts☆25Updated last year
- ☆27Updated last year
- ☆13Updated last year
- CHARacter-awaRE Diffusion: Multilingual Character-Aware Encoders for Font-Aware Diffusers That Can Actually Spell☆14Updated last year
- ☆48Updated last year
- DALLE-tools provided useful dataset utilities to improve you workflow with WebDatasets.☆15Updated 2 years ago
- Doohickey is a stable diffusion tool for technical artists who want to stay up-to-date with the latest developments in the field.☆39Updated 2 years ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- Generate images from texts. In Russian☆19Updated 3 years ago
- Tools for merging pretrained large language models.☆19Updated 7 months ago
- A neural network based file sorter. Trains an autoencoder to sort images or audio based on the similarity of their encodings, or uses the…☆29Updated last year
- ☆42Updated 2 years ago
- ☆40Updated 10 months ago
- ☆16Updated this week
- BIG: Back In the Game of Creative AI☆26Updated last year
- jupyter/colab implementation of stable-diffusion using k_lms sampler, cpu draw manual seeding, and quantize.py fix☆38Updated 2 years ago
- Finetune the 1.4B latent diffusion text2img-large checkpoint from CompVis using deepspeed. (work-in-progress)☆36Updated 2 years ago
- ☆24Updated last year
- I have created a dataset of Image-Text-Pairs by using the cosine similarity of the CLIP embeddings of the image & it's caption derrived f…☆15Updated 3 years ago
- A curve-editor for Stable Diffusion prompt interpolation☆21Updated 2 years ago
- ☆27Updated 3 years ago
- Make GPT-2 complete your text in Colab. Use fancy JS, instead of default ugly colab interface.☆19Updated 3 years ago
- Describe the format of image/text datasets☆11Updated 2 years ago
- ☆54Updated last year
- Training hybrid models for dummies.☆18Updated 2 weeks ago