cchan / nanoGPT-fp8
☆12Updated last year
Related projects ⓘ
Alternatives and complementary repositories for nanoGPT-fp8
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆23Updated 8 months ago
- A place to store reusable transformer components of my own creation or found on the interwebs☆44Updated 2 weeks ago
- ☆22Updated last year
- [WIP] Transformer to embed Danbooru labelsets☆13Updated 7 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆81Updated last year
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- ☆57Updated 11 months ago
- Make triton easier☆41Updated 5 months ago
- ☆41Updated 2 weeks ago
- QLoRA with Enhanced Multi GPU Support☆36Updated last year
- Collection of autoregressive model implementation☆67Updated this week
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- Data preparation code for CrystalCoder 7B LLM☆42Updated 6 months ago
- ☆62Updated last month
- ☆24Updated last year
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆25Updated last year
- Using multiple LLMs for ensemble Forecasting☆16Updated 10 months ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆28Updated 2 months ago
- A repository of projects and datasets under active development by Alignment Lab AI☆22Updated 11 months ago
- ☆36Updated 2 years ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 8 months ago
- ☆99Updated last month
- ☆18Updated last year
- Data preparation code for Amber 7B LLM☆83Updated 6 months ago
- ☆20Updated last year
- Chat Markup Language conversation library☆54Updated 10 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Updated this week