cccntu / LoRAnanoGPT
The simplest, fastest repository for training/finetuning medium-sized GPTs.
☆18Updated 2 years ago
Alternatives and similar repositories for LoRAnanoGPT:
Users that are interested in LoRAnanoGPT are comparing it to the libraries listed below
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆21Updated 8 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- Load any clip model with a standardized interface☆21Updated 11 months ago
- A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.☆16Updated 5 months ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- ☆63Updated 6 months ago
- Explorations into adversarial losses on top of autoregressive loss for language modeling☆35Updated last month
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- Latent Large Language Models☆17Updated 7 months ago
- ☆16Updated 6 months ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆23Updated this week
- CHARacter-awaRE Diffusion: Multilingual Character-Aware Encoders for Font-Aware Diffusers That Can Actually Spell☆14Updated last year
- ☆12Updated last year
- GoldFinch and other hybrid transformer components☆45Updated 8 months ago
- Finetune any model on HF in less than 30 seconds☆58Updated last week
- ☆49Updated last year
- ☆28Updated 8 months ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- implementation of https://arxiv.org/pdf/2312.09299☆20Updated 9 months ago
- Implementation of Spectral State Space Models☆16Updated last year
- Visualize multi-model embedding spaces. The first goal is to quickly get a lay of the land of any embedding space. Then be able to scroll…☆27Updated 11 months ago
- LoRA fine-tuned Stable Diffusion Deployment☆31Updated 2 years ago
- Utilities for Training Very Large Models☆58Updated 6 months ago
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated this week
- ☆21Updated this week
- ☆31Updated last year
- ☆13Updated last year
- Guide diffusion on ImageBind embedding similarity☆28Updated last year
- code for paper "Accessing higher dimensions for unsupervised word translation"☆21Updated last year
- A dashboard for exploring timm learning rate schedulers☆19Updated 4 months ago