cccntu / LoRAnanoGPT
The simplest, fastest repository for training/finetuning medium-sized GPTs.
☆18Updated 2 years ago
Alternatives and similar repositories for LoRAnanoGPT:
Users that are interested in LoRAnanoGPT are comparing it to the libraries listed below
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- ☆63Updated 6 months ago
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆36Updated last year
- Explorations into adversarial losses on top of autoregressive loss for language modeling☆35Updated last month
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆28Updated 3 weeks ago
- A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.☆16Updated 5 months ago
- Finetune any model on HF in less than 30 seconds☆58Updated 2 months ago
- Implementation of Spectral State Space Models☆16Updated last year
- Utilities for Training Very Large Models☆58Updated 6 months ago
- implementation of https://arxiv.org/pdf/2312.09299☆20Updated 8 months ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- A dashboard for exploring timm learning rate schedulers☆19Updated 4 months ago
- Implementation of the Mamba SSM with hf_integration.☆56Updated 7 months ago
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆21Updated 8 months ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- ☆20Updated 9 months ago
- ☆26Updated 2 years ago
- ☆16Updated last month
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆23Updated 2 weeks ago
- GoldFinch and other hybrid transformer components☆45Updated 8 months ago
- ☆13Updated last year
- Latent Large Language Models☆17Updated 7 months ago
- Implementation of a holodeck, written in Pytorch☆17Updated last year
- A fast approach for translating a series of text prompts into a video. The 2022 NeurIPS Workshop on Machine Learning for Creativity and D…☆32Updated last year
- Load any clip model with a standardized interface☆21Updated 11 months ago
- Merge LLM that are split in to parts☆26Updated last year
- Tools for content datamining and NLP at scale☆42Updated 9 months ago
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆40Updated last year
- ☆12Updated last year
- This repository includes the code to download the curated HuggingFace papers into a single markdown formatted file☆14Updated 8 months ago