euclaise / supertrainer2000Links
☆49Updated last year
Alternatives and similar repositories for supertrainer2000
Users that are interested in supertrainer2000 are comparing it to the libraries listed below
Sorting:
- ☆53Updated last year
- Collection of autoregressive model implementation☆85Updated last month
- ☆80Updated last year
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆62Updated last year
- ☆78Updated 10 months ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- Code repository for the c-BTM paper☆106Updated last year
- ☆21Updated 6 months ago
- ☆34Updated 11 months ago
- QLoRA with Enhanced Multi GPU Support☆37Updated last year
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- NanoGPT-speedrunning for the poor T4 enjoyers☆66Updated last month
- GoldFinch and other hybrid transformer components☆45Updated 10 months ago
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆37Updated last year
- ☆19Updated 2 weeks ago
- supporting pytorch FSDP for optimizers☆79Updated 5 months ago
- Simple GRPO scripts and configurations.☆58Updated 3 months ago
- ☆20Updated last year
- Experiments for efforts to train a new and improved t5☆76Updated last year
- ☆22Updated last year
- Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers☆93Updated 10 months ago
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆114Updated 2 years ago
- Latent Large Language Models☆18Updated 9 months ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆28Updated 8 months ago
- An introduction to LLM Sampling☆78Updated 5 months ago
- ☆63Updated 8 months ago
- Cerule - A Tiny Mighty Vision Model☆66Updated 8 months ago
- A repository for research on medium sized language models.☆76Updated last year
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆68Updated last year
- research impl of Native Sparse Attention (2502.11089)☆54Updated 3 months ago